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FOREWORD 



Tlie theme of the Seventh Annual Research Convocation was 
"The Emerging Research Worker and His Needs.” At a time when 
problems are looming larger than ever and solutions seem sometimes 
slow in coming, the convocation justly addressed itself to the place 
of educational research in the larger social setting and, more spe- 
cifically, to the role that the educational researcher-can and will 
play. Certainly, the field of research in education is filled with hope 
and rich with promise towards solving the major problems of our 
day. The evolving role and function of the researcher his needs, his 
uses, and the unique contributions that he has to make-are 'bus 
becoming increasingly important in the context of modern times. 
The measured and thoughtful consideration of these .issues was 

the main thrust of the convocation. 

The following pages reflect these ongoing concerns. Major 
presentations focus on such topics as educational research and the 
accumulation of knowledge, curriculum modifications for the 
emerging research worker, the emerging research worker and his 
needs, and the question of whether the educational researcher shall 
be a computer scientist or a Renaissance man. Other talks considei 
such matters as research methodology, taxonomy, and the training 
of educational research workers. Focusing on specific knowledge in 
the field, reports of current research,;, discuss such areas as complex 
educational media, programmed learning, ►school administration, 
- research related to disadvantaged children, concept formation, in- 
structional mode, reading, and the Elementary and Secondary Edu- 
cation Act of 1965. In all of these, the major theme, the primary 
implication, is the expanding of educational opportunity for all. 

Finally, a word of thanks is in order to all those who contrib- 
uted to the convocation their time, efforts, and skills. Major speakers, 
symposium chairmen and participants, chairmen of reporting ses- 
sions, and die many individuals who presented papers all helped 
to make the convocation a worthy and valuable experience. Special 
tribute is due Richard M. Clark, President of the Association, 
Howard Berkowitz, Program Chairman, and Leo D. Doherty, Co- 
ordinator of the convocation. It is with contributions such as these 
that we may recall past convocations with pride, and look forward 
with keen anticipation to the convocations of the future. 

Lorne H. Woollatt 
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REMARKS OF WELCOME 



Mr. Chairman, Members of the Convocation: 

Welcome to the Seventh Research Convocation jointly spon- 
sored by the Educational Research Association of New York State 
and the New York State Education Department. 

Ill order to appreciate the progress we have made, you would 
need to have attended the annual meeting of the Association in 
1959. A handful of people met in Syracuse after the conclusion of 
the Conference of the Secondary School Principals Association. 
Business consisted simply of an apology for lack of progress in 1958- 
59, the election of officers, and a promise to do better. 

In the ensuing months, the Education Department agreed to 
sponsor a joint research convocation in 1960. This was a turning 
point in the organization of educational research in New York State. 
Today and tomorrow we expect 400 people to attend. As many as 
11 states and two Canadian provinces are likely to be represented. 
A group of undergraduate students exploring educational research 
is with us. 

The growing number of people in attendance is the result of 
the worthwhile nature of the program. Major speeches will relate 
to the theme of “The Emerging Research Worker and His Needs.” 
Dean Krathwohl of Syracuse University will start the theme in a 
few minutes dealing with “Perspectives on Educational Research." 
After lunch, Dave Bushnell's title will relate to “New Curriculum 
Modifications for the Emerging Research Worker.” At this eve- 
ning’s banquet John Carroll of Harvard, in his inimitable style, will 
talk of “The Educational Research Worker: Computer Scientist or 
Renaissance Man?” 

One of the most significant developments is that there are 25 
educational research trainees at this conference. They are the first 
wave of participants in New York State’s Training Program for 
Educational Research Workers. The program is cooperative; the 
major schools of education in the State accepting several trainees 
each. It is also cooperative in the sense that funding results from a 
special grant to the State Education Department under Title IV of 
the Elementary and Secondary Education Act of 1965. A second 
wave of 25 trainees will enroll in 1967. A further increase of 50 
is anticipated later. Trainees will study research on college cam- 
puses for a year. They will spend the second year in supervised 
field experiences in research in education. By June 1968, a number 
will be available as research workers in school systems. If you want 
more details, attend Symposium Number 5 at 11:00 a.m., Tuesday. 

The program is not limited by the theme. Eleven reporting ses- 
sions and symposia will range through research in programmed 
learning, psychology, instruction; methodology and computer aided 



instruction will be discussed. The closing session will deal with the 
new massive infusion of Federal program funds. 

And so I wish you a professionally happy two days. Get im- 
mersed in research. Enjoy our mutual fellowship and bring a friend 
in 1967. 



Lorne H. Woollatt 



GAINING SOME PERSPECTIVE ON EDUCATIONAL RESEARCH AND 

THE ACCUMULATION OF KNOWLEDGE 



David Kratliwohl, Syracuse University 

The now rapidly developing changes which are tak- 
ing place in educational research are signs of a healthy 
and growing science. To maintain this forward move- 
ment we need to understand where we are and, hav- 
ing gained this perspective, how we may move further. 

Comte noted over a century ago that each of our 
leading conceptions ,— each branch of our knowledge, 

- passes successively through three different theoretical 
conditions: the theological or fictitious ; the meta- 
physical, or abstract; the scientific, or positive. Edu- 
cation has been for centuries, and still is to this day, 
the subject of much “armchairing and abstract con- 
ceptualizing. It is only recently, however, that we have 
begun to achieve the third stage— that we are skilled 
enough in our powers of observation, meticulous 
enough in our documentation, and clear enough in 
our logic to be considered by others, and to begin to 
accept ourselves as “scientific.” Empirical educational 
research is in its infancy. 

Although excellent research texts were available 
thirty years ago — texts such as Monroe and Engleheart 
—relatively little research based on the methods they 
advocate was undertaken until the advent of the Co- 
operative Research Program in 1957. This program, 
administered by the U.S. Office of Education, began 
with a million dollars and has grown now to 70 mil- 
lion. A 70-fold growth in funding in a decade should 
be a matter of encouragement, but looking at the 
Federal pie as a whole, this slice is still woefully small. 
Recently, when the defense budget was some 70 bil- 
lion, expenditures for research and development com- 
prised about 7 billion-10 percent-of the total. 

The health and medical field is estimated to be a 
38 billion dollar industry in which about 2 billion is 
devoted to research and development, somewhat over 
5 percent. Educational expenditures probably amount 
to about 45 billion and yet a bare 150 million, about 
one-third of one percent, finds its way into research 
and development. Clearly, we are far from being in 
the same research league financially with other areas 
which vitally affect our socie ty. 

As might be expected of an infant science, our re- 
search projects tend to be small in a statistical sense, 



as well as dispersed and unconnected in a systems 
sense. We have few large studies such as Project Talent 
and the research recently completed by the U.S. Office 
of Education, the Equality of Education , Educational 
Opportunity Study. The rule has been studies at the 
30 to 60 student level. 

What do our present activities and our methods of 
research add up to? Inexperienced as our science is, 
we are making some important inroads on significant 
problems. We know better now than before, for ex- 
ample, how to analyze the role of the teacher, to de- 
termine by objective obseivation and assessment, the 
effectiveness of teaching in terms of its differential 
effects on student performance. 

Nietzsche wrote that “in large states public educa- 
tion will always be bad, for the same reason that in 
large kitchens the cooking is usually bad.” But, within 
the last few years systematic research has seen marked 
gains in our ability to devise better ways of individual- 
izing instruction. 

We've begun to see the role of the administrator 
much more clearly, to understand his relations with 
his board, how he chooses and relates to his teachers, 
how he engages the community in solving the prob- 
lems of education, especially in relation to that bitter 
pill, the bond issue. 

One important advance of our recent research has 
been an awakening to many ways in which new ideas 
are disseminated and adopted and the criticalness of 
more knowledge of this kind to change the schools. 

I could list other evidences of progress and, when I 
was through, you could add to it. The point to be 
made is that we have been gaining knowledge about 
the educational process that can make a difference. As- 
suming this, two questions seem paramount. First, are 
we progressing as rapidly as possible? Second, are we 
structuring our research so as to facilitate that pro- 
gress? We need to be concerned with how to increase 
the speed as well as the effectiveness with which we 
accumulate knowledge. It is on these matters that I 
will suggest 9 points of varying importance. Let us run 
through them quickly to set the scene and then return 
to each for a more detailed look. 
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First, the logic of hypothesis testing should put the 
emphasis on the certainty with which knowledge is 
held; 

Second, more meaningful measuring scales should 
increase the practical significance of new knowledge 
and facilitate the study of the inter-relationship of 
variables; 

Third, study of the effect of a variable throughout 
its range of values should be more conducive to theory 
building than merely knowing the direction of effect 
(implicit here is the important assumption that theory 
building is critical to knowledge accumulation) ; 

Fourth, and perhaps heretically, frank disclosures of 
the shortcomings of studies should greatly ease the de- 
termination of their contributions and facilitate the 
design of complementary studies; 

Fifth , a study of the seriousness of certain violations 
of accepted practice might relieve us of restrictions on 
our research; 

Sixth, a re-examination of present criteria for the 
dissemination of the results of research to the academic 
community might suggest improvements important to 
the accumulation of knowledge; 

Seventh, replication of studies should be increased 
as a necessary part of the validation process; 

Eighth, shortening the time span between inventor, 
innovator and discoverer, and the consumer, can be 
achieved by more convincing design of studies, by 
more and more careful and explicit exposition of the 
relationship of the immediacy of these studies to the 
consumer’s notions of the real world, and by the ex- 
ploitation of every sound technique of information 
retrieval and dissemination; 

Ninth, research resources should be spent where the 
largest payoff at any stage of development of a research 
area can be expected. 

Now, let us examine these points more closely: 

Improving the Logic of Hypothesis Testing 

I have suggested to you that the logic of hypothesis 
testing needs to be refocused. Our present approach 
involves the disconfirmation of a null hypothesis— 
rather than a positive validation of those ideas which 
merit acceptance. We are seeking a binding identity 
between an hypothesis and that fragment of the real 
world it attempts to describe. 

The disconfirmation technique gives us no way of 
stating how much more certain we are that the prin- 
ciple or knowledge being tested is true at the end of 
the study than we were at the beginning. Each study 
is merely one more link in a chain of evidence upon 
which a judgment must be made. If a study is a tight 



one, and the expected effect does not occur, a total 
invalidation of the hypothesis is achieved. But, a set 
of results which confirm provides an indication, rather 
than a total proof of soundness. This is the logic of 
the situation, and it is only as an hypothesis repeatedly 
escapes disconfirmation in a series of tests that it can 
be accepted, and then only conditionally. 

The essential value of Bayesian statistics is that it 
focuses on the certainty with whidi knowledge is held 
true. The researcher is required to evaluate the ac- 
cumulated evidence in support of his proposition. 
From this, he establishes in probability terms his first- 
level confidence in the proposition. Then, continuing 
his investigation by experiment, this initial a priori 
probability is modified to reflect appropriately the fact 
that evidence disconfirms or confirms the hypothesis in 
question and, thus, a second-level probability position 
is taken. This process, which is carried on to the limits 
of practicality, has the advantage of developing a 
statement of where the researcher stands in the con- 
firmation process, as well as the increment or decre- 
ment in probability terms that each experiment adds. 

The Bayesian approach emphasizes understanding 
of the sureness with which knowledge is held, and thus 
permits the application of this knowledge within a set 
of reasonable and realistic expectations. The present 
limitation on the technique is the problem of estab- 
lishing a reliable process for determining a priori 
probabilities. Progress, however, is being made and 
enough is already known to use the Bayesian statistical 
method on a number of problems. It appears reason- 
able to expect that as we widen the application we will 
greatly speed up the accumulation of knowledge and 
strengthen our ability to use it. 

The Need for More Meaningful Measuring Scales 

My second point suggests that we can facilitate the 
accumulation of knowledge by developing more mean- 
ingful measuring scales. The most useful that we now 
have are those tied to normative bases such as age or 
grade norms. Typically, however, the reader of educa- 
tional research is faced with, let’s say, a two-point gain 
on an unknown test and the assurance of the experi- 
menters that the gain is significant at the 5 percent 
level of confidence. When the test is especially con- 
structed for the experiment, the reader is usually left 
badly adrift. What do these results mean to the deci- 
sions that must be made? How much is a two-point 
gain worth in dollars as ah improvement in learning 
methods? Does the 5 percent level assign the principles 
developed in the experiment to the category of unac- 
ceptable risk? 
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If we could tie more meaningful tags to the gain 
scores, we might achieve the practical end of saying 
that a two-point gain will net the student “x” dollars 
in increased salary when he graduates or will result in 
“y” minutes in time saved in bringing a student to a 
given level of achievement in school. It is admittedly 
difficult, and unquestionably dangerous and distaste- 
ful, to try to assign monetary values to learning, since 
it requires putting a price tag on intellectual and hu- 
manistic values. Still, we need to find some way of 
bringing meaning to our measuring scales. From the 
point of view of the practicing educator, the use of 
monetary or time standards may be a welcome first 
step. We seem to have largely abandoned research in 
this area, but it is one that would pay very large divi- 
dends if better solutions could be found. 

The lnter*relation of Variables 

The third proposition concerns the improvement of 
our understanding of and ability to work with the in- 
terrelation of variables. We have developed analysis 
of variance techniques to a level of sophistication 
which is sufficient to analyze very complex problems. 
But, analysis of variance tells us only the direction of 
effects and which of the effects cannot be charged to 
error. Unless a study is so designed that the experi- 
mental variable is present at several levels of strength, 
it does not permit the experimenter to plot the way 
one variable affects one or more of the others as it 
changes in intensity. For example, most recent studies 
of achievement in schools where schoolrooms have 
been integrated across social class lines indicate ad- 
vantages in favor of the lower class children. But these 
studies generally lack persuasive force because the ex- 
istence of incremental variations, so important to dem- 
onstrating generalizing principles, has not been in- 
vestigated. One might ask: How does the proportion- 
ate mix in social class relate to the average achieve- 
ment score? Is it maximized when lower class children 
are in the minority? In the majority? When the classes 
are equal? At some point of optimization? It seems 
clear that a plot of the function relating mix to 
achievement scores and further delineated by the im- 
press of other related variables would be most useful 
in understanding how these functions interact. 

Combined with the plea for more meaningful 
metrics, this further suggests that we would rediscover 
the neglected art of curve fitting. This process was 
regularly taught in statistical courses in the 20’s but 
has lapsed into disuse. Curve fitting gives precise in- 
formation for theory building that is available no 
other way. It may be time to reconsider its use. 



The Compromise in Research Design and Its Disclosure 

The fourth area of importance is taking conscious 
action to make clear the weaknesses as well as the 
strengths of our studies. Doctoral dissertations typi- 
cally include a section called “Limitations of the Re- 
search,” intended to help the candidate circumscribe 
his problem into reasonable limits. But the necessity 
for doing a study within reasonable limits of time, 
energy, finances, and available situations is hardly con- 
fined to doctoral candidates. We all face it. In a very 
real sense, nearly every study is a compromise with 
ideal criteria. The complexities of the phenomena we 
study and the fact that the criteria for judging practi- 
cal studies are not always internally compatible, force 
such compromises. 

The researcher who gathers his evidence from a real 
situation, such as the classroom, is faced with a host of 
factors to control if he is to reason his way to a con- 
nection between observed effect and experimental 
variable. In a teaching methods experiment, for ex- 
ample, he must control for differences in the abilities 
of teachers, for differences in their enthusiasm for one 
method or another, for Hawthorne effect, for pretest 
effect, for pupil abilities, for socioeconomic environ- 
mental factors, for academic climate and school en- 
vironment, and so on. If this confusion drives him to 
do his research in the laboratory, using neutral ma- 
terial such as nonsense syllables and memory drums, 
he may in the end have compounded his dilemma. 
Now, he is faced with problems of relating his results 
to the classroom and an uncertainty of whether and 
how they will generalize, which can be resolved only 
by actually doing the study he tried to avoid. 

If we can get each investigator (who probably knows 
the nature of his compromise better than anybody 
else) to describe it and the rationale for this choice 
in his report, if we can convince editors and their 
advisory staffs that such a study is increased i.n value 
by such candor, readers will find it somewhat easier 
to judge the value of the study for themselves, other 
researchers could more easily design complementary 
studies with different and offsetting compromises.^ 

I can further illustrate the complexities of choice 
leading to compromise by a recent case involving a 
study of programmed material. Most such studies have 
been done with relatively few cases. Thus, the com- 
mon finding of "no significant difference” may result 



1 Alternatively, a journal critiquing current periodical litera- 
ture would probably better fit the .current publishing pattern 
and might at least partially serve the function described. Simi- 
larly, more critical reviews of research could facilitate this pur- 
pose. r 
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from the fact that there are insufficient cases to pro- 
vide a precision adequate to sense the experimental 
effect. Now how should one increase the size of the 
group yet keep experimental control? Ideally, the pro- 
gram would be administered in a teaching machine, 
so we would know the student went through the pro- 
gram step by step, didn't peek at the answers, had a 
quiet room, and so on. On the other hand, to do so in 
the context of the course would require a great many 
machines, suitable space, supervision, and tight sched- 
uling, if the pace of the course were to be maintained. 
Finally of course, one needs the money to pay for all 
this. In this particular instance, the compromise was 
the use of a large sample of students who took the 
materials home with them to study, thus relaxing 
some control over how they would use them. The in- 
crease in sample size markedly increased the sensi- 
tivity of the study but, of course, at the cost of some 
loss of control. At the same time, the conditions used 
were closer to those under which the materials would 
actually be used in practice and so increased the prac- 
tical generality of the findings. This is an example of 
the kind of compromise that faces every investigator. 

The Evaluation of Assumptions Underlying Research 

The fifth suggestion on my list is closely related to 
the fourth. As noted earlier, it is rare that a study does 
not violate at least one of the criteria by which its 
quality would be judged. Yet, we have only some be- 
ginning studies to tell us how serious such violations 
are. 

For example, many of us have long considered the 
Hawthorne Effect a serious problem unless properly 
controlled. Hawthorne Effect results from the special 
attention given to an experimental group, which may 
itself affect the dependent variable even though the 
independent variable does not. The concept developed 
in the early twenties when Roethlisberger, Dixon and 
others conducted experimental investigations of 
worker motivation at the Hawthorne plant of the 
Western Electric Company. Now, some 40 years later, 
Desmond Cook's study of this phenomena raises some 
very serious questions about the extent to which this 
effect is as pervasive and strong as previously supposed. 

The violation of the assumptions of statistical tests 
is a common breach of criteria, sometimes considered 
serious enough to invalidate the inferences drawn 
from a study. But a study such as Norton’s, as reported 
in Lindquist’s Design and Analysis of Experiments , 
concerning the “F” test and similar studies on other 
tests have shown these tests to be astonishingly robust. 
Even flagrant violations do not produce serious effects 



which cannot be compensated for by a simple cor- 
rection. 

We have had far too few such studies as Cook’s and 
Norton’s. It will no doubt pay us to regularly devote 
some portion of our resources to research on research 
itself, with a special emphasis on a re-examination of 
some of our dogma. 

The Need for Better Dissemination Techniques 
for New Knowledge 

Sixth in the chain of concerns is the variety of gate- 
keepers on the road between the generation of new' 
knowledge and its acceptance. These are such persons 
as the administrators and panel members of funding 
agencies, the journal editors, and the textbook authors 
and publishers. Their points of view may facilitate or 
may impede the accumulation of knowledge. There 
are two fairly common policies which appear on the 
surface to inhibit knowledge accumulation. One of 
these is the heavy emphasis on the part of the editorial 
establishment favoring empirical research over various 
kinds of theory building or “think pieces.” Skinner’s 
article in Science heavily influenced the programmed 
learning movement, but there are few comparable ef- 
forts today appearing in the journals. Editorial policy 
may be only part of the cause, for such articles are 
less likely to be prepared if publication outlets are not 
available. It is the familiar chicken and egg situation, 
with such articles likely to stimulate additional such 
production. 

The second policy is the burial without notice of re- 
search which produces negative results. Perhaps our 
gatekeepers are printing all such studies that are worth 
recording, but this is questionable. Let me document 
this point from personal experience. We were recently 
thinking about designing a program to attract women, 
who had been teachers or taken teacher training, back 
into the field after their family responsibilities light- 
ened. We were interested in the problems of remotiva- 
tion and retraining. We understood that several pro- 
grams attempting this same task in the post-World 
War II years had not been successful, but the diffi- 
culties of such programs did not appear in the usual 
publication channels. This makes it very difficult to 
avoid repeating the errors of the past. 

We are caught in an information selection, process- 
ing and dissemination situation-one hardly can grace 
it by calling it a system-which, like Topsy, just grew. 
The above represent two policies which appear to be 
weaknesses in this system, but we need some studies 
of it which better indicate how it facilitates and how 
it impedes the accumulation of knowledge. 



Increased Replication To Assure Validity 

The seventh matter listed refers to the importance 
of replication as a necessary part of the validation 
process. It may seem unnecessary to comment on a 
point so self-evident, but, for a variety of reasons, we 
had had little replication in education research. There 
has been a need to stretch our research funds at the 
cost of thoroughness. There have been the temptations 
of unexplored fields and the natural preference of re- 
search investigators to adventure into these new fields 
rather than to secure those already won. 

The sad reality of research, especially in the social 
sciences, is that replication is one of the few techniques 
of validation available to us. If our new knowledge is 
to find its way into the mainstream of education and 
if educational science is to mature, we must engage in 
replication and endure its burdens of cost and time. 

Shortening the Time Between Discovery and Use 

The eighth point concerns the very long time from 
innovation or discovery to the consumers’ awareness 
that new knowledge is available. A recent study by the 
American Psychological Association found that an 
average of 5 years elapses between the start of a study 
and its citation in a research review, and of these 5, 
at least 3 years elapse to journal publication. In ad- 
dition to these years, time required to write a funding 
proposal, wait for its approval, and obtain actual fund- 
ing can easily add 6 months, a year, or more. Finally, 
of course, if the study has practical implications, there 
is the considerable period of time involved in getting 
the results accepted and implemented in the field. 

A number of efforts are under way to reduce this 
time lag, and studies have begun of the dissemination 
and adoption process. Hopefully, ERIC, the Educa- 
tion Resources Information Centers of the U.S. Office 
of Education, will reduce proposal preparation time 
by helping researchers retrieve relevant research. 

Perhaps the biggest lag is in the use of research re- 
sults. At one time, the delay in adoption of new prac- 
tices was estimated to be as much as 40 years. This 
situation appears to be improving. The new mathe- 
matics programs, for example, seem to have been 
■widely adopted in about a decade. 

Could researchers reduce field dissemination time 
further by building more convincing studies? Investi- 
gators are concerned primarily with communicating 
with fellow researchers, and they build studies pri- 
marily in the form and to the size needed to achieve 
statistical significance. What may be relatively con- 
vincing to a fellow researcher, however, may not be 



even minimally convincing to a research user. In de- 
veloping certain studies, the researcher needs to cast 
a glance over his shoulder at the waiting, potential 
users, and build his case from the start which, if the 
expected results appear, will be convincing. Small, 
carefully built, carefully controlled studies contribute 
knowledge and assist in building a convincing impres- 
sion, but sample size and number of replications are 
particularly important. 

The Equality of Educational Opportunity Study of 
the National Center for Educational Statistics is an 
example. This was an attempt to document the condi- 
tions under which Negroes attend school. A small 
study would have failed in its task. This study makes 
its case by involving 4,000 schools, 20,000 teachers, and 
645,000 students. Implications and principles of action 
for the bulk of the Negro community are much more 
certain with sample sizes of this magnitude. Educa- 
tional research is only beginning to develop studies of 
this complexity and magnitude. We ought to consider 
with some care whether there are not more instances 
where the results of a study would be greatly strength- 
ened, and the transfer and use of new knowledge 
greatly accelerated by such augmentation of the data 
base. 

It will be helpful too, if we do a better job of help- 
ing the consumer understand the method of science. 
We say that we believe that knowledge is only held as 
true until it is replaced by new knowledge. But the 
continuum on which a scientist scales the certainty of 
the knowledge he holds is not usually made obvious 
to the consumer, who acts as though the choice is 
dichotomous, either true or false. Better understand- 
ing of the uncertainty of findings might open con- 
sumers to a willingness to change, to understand the 
occasional starts, stops, and perhaps even reverses in 
the accumulative process. For example, the lack of 
empirical support for the original principles used to 
shape programmed instruction is less confusing to the 
researchers, who understand how the process could go 
awry, than it is to the research consumer, who takes as 
gospel the programming principles originally de- 
veloped. 

There is something of a parallel to be drawn with 
the fourth point which concerned the need for dis- 
closure of the limitations of research projects. Such 
limitations and uncertainties, properly explained to 
the consumer, could bring about greater understand- 
ing of the scientific process and hasten rather than im- 
pede the application of knowledge. 

Such publications, designed for nonspecialists, as 



9 



Washington University’s Transactions , which explains 
social science research, and Scientific American which 
explains a variety of science areas, have helped reduce 
the communication lag between researcher and con- 
sumer, and give some perspective on the research 
process. Perhaps such a journal for education would 
be something that we ought to consider. 

Choosing Appropriate Targets for Research Effort 

The ninth and final area for comment deals with 
the dilemma of appropriately using our resources for 
maximum return. Some of the same forces that have 
acted to discourage replication have also tended to 
spread our research over a variety of areas. Thus, in 
the past, research fluids in education have, in general, 
been relatively unconcentrated. But Congress in par- 
ticular, the public in general, and increasingly of late, 
the U.S. Office of Education, have assumed that our 
problems can best be solved by important concentra- 
tions of funds and effort. In general, however, concen- 
tration of resources is more likely to result in funding 
leads that do not have a return. More blind alleys will 
be explored as greater risks are taken in attempts to find 
a breakthrough. Still, such concentrations may well 
result in solutions. Whose crystal ball is clear enough 
to gainsay this? In an open invitation research pro- 
gram, researchers typically propose problems they con- 
sider ready for solution. This represents their best esti- 
mate of where to spend the funds, for they rarely want 
to explore an area in which they do not expect to suc- 
ceed. But their choices are often not in the areas of 
greatest societal need. 

It is important that we learn to recognize the con- 
currence between the desirable concentration of funds 
and the readiness of a particular area for a break- 
through if we are to gain the best use of our resources. 
This concurrence may be affected by answers to such 
questions as: What is the state of the art and the 
knowledge of research in an area proposed for concen- 
trated funding? (What kinds of funds and efforts will 
it take to engineer developments in an area? What has 
been the past success in engineering similar efforts?) 
What are the alternative uses of funds? (The problem 
areas ready for concentration of funds may be com- 
paratively trivial in importance.) What is the level of 
funding available? (A balance is needed between the 
funds required to engineer the development of an area 
and the funds available for research in other im- 
portant areas.) 

What is the disposition of the research community 
toward an area? (Will one be able to command talent 
that is both motivated and adequately skilled to do 



the development task— or is this a low prestige area, or 
an area for some other reason outside the boundaries 
of a scientific orientation?) Depending on the close- 
ness to solution of a problem, the state of the art of 
research, the level of funding available especially w’ith 
reference to alternative ways of spending funds, and 
the orientation of the research community, there is 
probably an optimum solution to the employment of 
our research means. We need to devote some study to 
the process of resource allocation. We should, for ex- 
ample, check the accuracy of predictions made about 
specific decisions which attempted to balance variables 
such as those noted above. In this way we can learn to 
approach much more rapidly the maximum accumula- 
tion and use of knowledge. 

Summing Up 

We have ranged over a number of areas in which 
some effort and/or study might improve educational 
research, either in a limited way or perhaps by an 
order of magnitude. Summing up, we have considered: 

First, a more appropriate statistical logic for investi- 
gation; 

Second, the need for more meaningful measures; 

Third, the increased use of techniques to study the 
relation between levels of strength of variables and 
effects; 

Fourth, the compromise in research design and the 
value in its disclosure; 

Fifth, a call for a determination of the gravity of 
violating certain criteria established for “good” 
studies; 

Sixth, the need for re-examining the criteria used 
by the gatekeepers of research communications; 

Seventh, the need for greater replication in research; 

Eighth, ways of shortening the time gap between the 
development of knowledge in research and its transfer 
in usable form to the consumer; and 

Ninth, the need to channel funding into patterns 
and paths to provide the greatest overall return for 
education. 

These are by no means all the points that one could 
raise about this topic. But this is a side of research 
that is seldom given consideration. We are so busy 
doing research and attempting to apply research find- 
ings that we do not examine the process itself. Perhaps 
this discussion will stimulate you to stand back and 
similarly try to put the process in perspective. Such 
efforts are important if educational research is to 
reach maturity. 



CURRICULUM MODIFICATIONS FOR THE EMERGING 

RESEARCH WORKER 



David Bushnell, United States Office of Education 

I’m very happy to share with you some of my own 
views on what's been happening in the Bureau of Re- 
search in the U.S. Office of Education. We have ap- 
proximately $90 million to spend this year. Let me 
add, however, that this is the year of austerity. We lost 
20 million dollars that we had expected to be ap- 
propriated. Ten million of it came out of the Ele- 
mentary and Secondary Education Act, Title IV, re- 
ducing that appropriation from 80 to 70 million dol- 
lars. The second, and even harder to accept reduction 
was in my own program, the vocational education 
research monies, where we were cut by 50 percent 
from what we had hoped to be a 20 million dollar 
appropriation to 10 million dollars. This has led us to 
some agonizing reappraisal of what we have funded. 
We have continuation costs of about 8 million dollars, 
and we had already obligated something like 5 million 
dollars, putting our budget at a 13 million dollar level. 
Now we have to cut back to the 10 million appropria- 
tion. We’re not going to be entertaining very many 
new projects this year. Those that are well designed 
and worthwhile will have to be carried over to the 
next fiscal year. I’m not speaking for the entire Bu- 
reau of Research, just the monies appropriated under 
the Vocational Education Act of 1963. Some of the 
studies that are underway with fiscal ’67 funds will 
have to be reduced. This period of poverty reminds me 
of a gentleman that we ran across in the hallways of 
the office the other day who was wandering around, 
looking a little disheveled and unkempt. He was say- 
ing that he had been reading about the President’s 
declaration of war on poverty and he was here to 
surrender. 

You’ll be happy to know that we’ve introduced sys- 
tematic planning into the Bureau of Research. We 
have tried to set forth for this year several priority 
projects that we’d like to fund. Some of these represent 
the legislative requirements, the regional laboratories, 
and the research training program, and others, we 
think, ought to be focused on major problems or new 
technological developments that offer some hope of 
overcoming many of the problems being faced by the 
public and private schools in this country. In the set- 



ting up of these priorities, several Division Directors 
in the Bureau and Dr. Bright got together to talk 
about how we could better coordinate the activities of 
each research division. As you know, we now are struc- 
tured with five divisions, three of which are designed 
to serve as the R & D arm for the three major bureaus 
in the Office of Education, that is, the Division of Ele- 
mentary and Secondary Research, Division of Higher 
Education Research, and the Division of Adult and 
Vocational Research. We’ve been in the process of pin- 
pointing what we mean by these priority areas but we 
are not quite ready to release them to the research 
community. I did think it would be appropriate, 
though, for me to say a word or two about how we are 
structuring these priorities and perhaps, by way of 
example, describe in a little more detail one such ef- 
fort. Several staff members in the Bureau have been 
assigned responsibility for a given priority. One staff 
member is to serve as a team captain, drawing upon 
not only the personnel and resources within the Office 
of Education to help structure a position paper, but 
also upon expertise in the field, consultants whom we 
can bring in as advisory members of the Task Force 
on a given priority topic. For example, if we were 
concerned with the problem of improving the admin- 
istrative pattern for a statewide system of community 
colleges, we might well look to people such as your- 
selves for help in planning how to invest research 
funds in this particular problem area. Once a paper 
is developed, we are then in a position to release it to 
the field and solicit proposals which meet the criteria 
of the position paper. In other words, we’re now in 
the process of emphasizing sponsored research. We will 
still accept unsolicited proposals, but most funded 
projects will releate to the particular priority areas 
that we are committed to this year and next. 

In addition to supporting sponsored and unsolicited 
proposals, current legislation directs us to administer 
other programs within the Bureau of Research. I'm 
now referring to such programs as the regional labora- 
tories and to our research training effort that has just 
been launched. There are some nineteen regional lab- 
oratories now in operation or on the drawing board. 
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About 18 to 22 million dollars is to be allocated out of 
this fiscal year’s money in order to support the imple- 
mentation of these laboratories. Their primary pur- 
pose, of course, is to make information and consultant 
help available to local school districts, to encourage 
the implementation of really significant and promis- 
ing innovations. The laboratories are designed to 
bring together researchers and practitioners from the 
universities and local school districts. In many parts 
of the country, groups that are now cooperating in the 
regional education research laboratories had not had 
much communication with one another previously. 
Overall, the Office of Education last year spent about 
10 million dollars on this program and we have 
budgeted 18 to 22 million dollars this fiscal year. Dr. 
Bright sees the new laboratories as the necessary link 
in the chain of progress that leads from basic research 
to widespread classroom practices. 

The research training program is an effort in which 
I hope all of you have considerable interest. It began 
in 1965 with the passage of the Elementary and Sec- 
ondary Education Act. Eight million dollars were al- 
located to it last year, and we expect to fund it at 
about that level again this year. Its purpose, of course, 
is to help train a larger number of educational re- 
searchers in this country than have been trained in the 
past. There are only about six thousand people now 
engaged in educational research. We expect that by 
1972 there ought to be well over one hundred thou- 
sand in this area. The purpose of the program is to 
improve the quality of educational research training, 
and to increase the number of training opportunities 
by expanding existing programs and adding new ones, 
as well as by providing support to trainees and en- 
abling more students to prepare for careers as educa- 
tional researchers. You will be interested to hear that 
the State of New York received over a million dollars 
last year to implement such programs. One of the more 
interesting grants, and really the largest single dollar 
appropriation, some $323,000, was awarded to the New 
York State Education Department. The Department, 
in cooperation with several universities v>. ; thm the 
state, developed a program designed to meet certifica- 
tion requirements for appointment to educational re- 
search positions. Fifty trainee positions were author- 
ized under this initial funding. There are other re- 
search training grants at Columbia, Cornell, Fordham, 
Syracuse University, and even one to Rockland Com- 
munity College, for the support of a research training 
institute for junior college personnel with research in- 
terests. Also, I don’t know whether you’ve seen the 



recent announcement that we’ve just published on a 
new National postdoctoral fellowship program to be 
awarded by the U.S. Office of Education. If you’re in- 
terested, you can write a note to Lee Burchinal, Di- 
rector of the Division of Research Training and Dis- 
semination at the Office of Education, and he’ll be 
happy to send you all the details on this effort. 

The National post-doctorate fellowship program is 
designed to provide opportunities for a limited num- 
ber of fellows to engage in an intensive postdoctoral 
training experience with some of the Nation’s out- 
standing researchers. In other words, these fellowships 
will be allocated to R & D Centers, regional labora- 
tories, or other institutions which are eligible to re- 
ceive funds under the education research training pro- 
gram. The fellowship stipend would be equivalent to 
the salary such a recipient would have received 
through continuation of his regular employment. In 
addition, there is a $2,000 allocation for travel and 
incidental cost. Recipients will be invited to attend an 
invitational seminar conducted at the U.S Office of 
Education at the opening of the program, and also a 
second invitational seminar at the conclusion of one 
year’s residence in the program. 

Returning to the topic of research sponsored by the 
Office of Education, I would like to present to you a 
concept which we have recently adopted; that of spon- 
sored versus unsolicited research projects. As an ex- 
ample, I would like to describe one example of a sys- 
tematic attack on a major problem facing American 
education so that you might better understand what 
we mean by a program of sponsored research. Several 
months ago, we became concerned that the 20 or so 
million research dollars invested in curriculum devel- 
opment projects were not yielding a successful return 
on that investment. Too many of the projects were 
small scale efforts with little hope of their replication 
elsewhere. Consequently, we established a systematic 
plan for revamping the high school and post secondary 
or junior college curriculum to better serve the needs 
of both college bound and noncollege bound young- 
sters. 

Unfortunately, much of what now is being taught 
in our public schools fails to recognize that technology 
has generated profound changes in the nature of work. 
The tendency to separate those in the college pre- 
paratory programs from those in the vocationally 
oriented programs has handicapped both groups. 
Those who plan to go on to college are not prepared 
to cope with the question of what happens if they have 
to drop out-and as you know a great number of stu- 



dents entering college do drop out before completion 
of the bachelor's degree. Those in the vocational pro- 
grams find themselves being trained for a narrow 
range of job skills and receive too little positive rein- 
forcement to develop confidence in their basic learn- 
ing skills. They not only need to have the kind of 
entry level qualifications that get them the job in the 
first place, but they must have the kind of cognitive 
skills and problem solving capabilities that will allow 
them to progress in that job or to qualify for new 
careers. Eight out of ten students in our classrooms to- 
day at the secondary level will wind up in jobs requir- 
ing less than a bachelor’s degree. 

If we were to employ vocational preparation as the 
principal motive, it’s our feeling that the inculcation 
of some of the basic learning skills, reading, writing, 
mathematics, could be made more palatable to many 
students. 

We feel that a massive research effort is needed to 
develop a curriculum which would provide every stu- 
dent with the job skills he needs to enter into his first 
job and to condnue his employment even if he were 
to drop out before completion of high school. The stu- 
dent who graduates from the program should possess 
the necessary qualifications for maximum flexibility in 
his post high school activities. He might enter a uni- 
versity or a community college and pursue an academic 
program. He might enter a community college or a 
technical school and receive post high school occupa- 
tional training. He should also have entry-level oc- 
cupational skills which permit him to go to work. He 
should have the additional option of continuing his 
education in an adult education program. The key 
point is that he should have several options available 
to him after graduation from high school. 

An Organic Curriculum 

The first step in building such a studenK entered 
curriculum is to study those behavioral attainments 
needed by the individual for entry into a variety of 
post high school activities. Whenever possible, these 
requirements should be stated specifically and in mea- 
surable behavioral terms. Following the lead of the 
systems analyst, we should describe as specifically and 
precisely as possible the learning experience which 
would lead to the desired behavioral outcomes. 

The ingredients of a high school program which 
will assure the attainment of these specifications will 
certainly include academic as well as occupational 
training but may also include such components as per- 
sonal development, real work experience, and indi- 
vidualized vocational counseling. Even the avocational 



or school-sponsored recreation or social programs may 
be considered an integral component in this system. 
Each of these components and subparts must be de- 
fined in terms of its contribution to the attainment of 
the specified behavioral objectives. 

The most important feature of such a curriculum is 
that it is learner oriented rather than process or sub- 
ject matter centered. The integration and interaction 
of the components will be a result of careful systems 
design. There will be no discrete demarcation between 
academic and vocational skill training or between 
these and other parts of the system. The truly integral 
curriculum must be developed so that each activity 
relates logically to all other activities and leads to the 
efficient attainment of the behavioral goals. 

Such a curriculum is presently feasible and can pro- 
duce significant improvements in the learning process. 
An “organic” curriculum would necessarily have to 
be interesting, challenging, and motivating to each 
student. It would probably utilize appropriate self- 
paced and self-instructional technology and maximally 
accommodate individual differences in learning rate. 
It should be designed so each student will succeed and 
yet it should be rigorous in level and content. Further- 
more, after thorough experimentation and revision, 
the integral curriculum should be capable of imple- 
mentation in, or adaptation to, many different compre- 
hensive school systems in the Nation; and it should be 
cost elective in the implementation stages. 

« 

Summary of Various Elements of This Grand Design 

First, we hope that this curriculum effort will em- 
phasize the articulation between the academic and the 
vocational for the purpose of fusing the two programs. 
Employing the vocational preparation as the major 
vehicle, or motivation tool, the inculcation of basic 
learning skills could, we think, be made more tolerable 
to many students who have a hard time seeing the 
value of general education. 

Second, we would like to expose students to an un- 
derstanding of the real world through a series of ex- 
periences which capitalize on the universal desire of 
youth to investigate; for themselves. Abstract and ver- 
bal principles could be acquired through nonverbal 
stimuli such as seeing and feeling and interacting. 

Third, we would like to develop a core of skills 
which relate to a cluster of occupations rather than 
just a specialized manipulative skill in one occupa- 
tional area. Students with that type of background 
could, if necessary, transfer to a related type of occu- 
pation without a great deal of retraining. 

Fourth, we would like to orient students through 
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this new curriculum to the attitudes and habits which 
go with successful job performance. It’s quite obvious 
to many employers that most workers are not able to 
perform the jobs assigned to them. Those who get 
fired are the ones who, because of attitudes, are unable 
to accept responsibility for themselves; simple things 
like getting to work on time, getting along with their 
peers, and accepting supervision. 

Fifth, we would like to provide a background for 
the worker by helping him to understand how he will 
fit into the economic and civic institutions of his 
community. There is now considerable work under- 
way at Ohio State, at Columbia, and elsewhere, on de- 
veloping a better way of presenting the concept of a 
free enterprise economy to students at the junior and 
senior high school levels so that they might gain some 
understanding of the economic and social structures 
within which they will operate before going on to pre- 
pare for whatever occupation they may choose, be it 
at the professional or subprofessional level. 

Sixth, we want to maximize the opportunity for a 
student to develop and enjoy a positive learning ex- 
perience regardless of his level of ability and back- 
ground. A lot of work is being done, as you well know, 
on programmed instruction and individualization of 
the instructional process in such a manner that a stu- 
dent can derive a positive reinforcement as he pro- 
gresses through the curriculum materials. 

Seventh, we would like to help students cope with a 
changing labor market through developing their prob- 
lem solving abilities and a series of career strategies 
which lead to an adequate level of income and re- 
sponsibility. 

Last, and perhaps most important, we would like to 
create within the student a sense of self-reliance and 
awareness which leads him to seek an appropriate 
career and aspirational level. 

As you see, we’re really not talking about revising 
just vocational education. We’re talking about a much 
broader program to modify curriculum for the ele- 



mentary and secondary schools. We hope through team 
teaching arrangements to involve teachers from vari- 
ous disciplines, bringing them together to work out 
an integrated (with a small “i”) curriculum for these 
noncollege bound students or those who are likely to 
leave school at some point before they complete their 
baccalaureate degrees. In general, this type of effort 
should tap the total capacities of the individual, in- 
cluding his intellectual, manipulative, creative, and 
social capacities, as well as emphasize the discovery of 
abstract concepts through the examination of real 
world events and learning which is experien dally 
based. Shop and laboratory experiences should be 
brought in to provide a counterbalance to the other- 
wise heavy verbal learning exposure. 

I’d like to enlist your support in this kind of en- 
deavor, and those of you who are going ahead with re- 
search that relates to the noncollege bound or the dis- 
advantaged student ought to be involved. We are just 
beginning to go into the field with requests for pro- 
posals to help structure this enterprise, which will be 
organized, we hope, in a systems-like manner with per- 
haps even a PERT program that allows us to identify 
the critical actions which must take place at certain 
times along the way. We will be looking to the uni- 
versities for considerable help in field testing and try- 
ing out these materials on students. We are hoping to 
identify several types of schools and school districts, 
ranging from rural to urban, from advantaged to dis- 
advantaged, to serve as pilot schools. As this unfolds 
over the next 5 year period, there is going to be a lot 
of interchange of ideas with people in the field. We 
hope to keep communication channels open so that 
we can actively involve those who want to be involved. 

Let me just close my remarks by a quotation from 
Secretary Gardner, who says, and I quote, “No society 
is likely to renew itself unless its dominant orientation 
is to the future. A society capable of renewal may not 
only welcome the future and the changes it may bring 
but believes that it will have a hand in shaping that 
future.’’ Thank you very much. 
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-The theme of our Convocation is, “The Emerging 
Research Worker and His Needs.” What “picture in 
the mind” does this theme create for you? Do you see 
something akin to the Ajax White Knight riding down 
the halls of your school on a giant computer and in- 
stantly transforming the classrooms with his research 
findings? Or perhaps you see a kind of squalling in- 
fant, being born amid some pain and requiring much 
care and attention before he is of use to anyone. Does 
the emerging research worker that you visualize live 
professionally in an ivory towered university, on the 
fourth floor of the State Education Building, or in an 
office in a public school? 

As one now working in higher education I am in- 
terested in the program of preparation which would 
be appropriate for ail educational research worker 
to be employed by the public school. Just exactly what 
should he be prepared to do? I would like to consider 
with you today five roles that the emerging research 
worker might play in the public school setting. I do 
not suggest that these roles are mutually exclusive, but 
I do believe that each role may require special train- 
ing experiences. 

One role which the emerging researcher might play 
is that of a “system-free truth seeker.” Hilgard, in his 
essay A Perspective on the Relationship Between 
Learning Theory and Educational Practice, in the 
1964 NSSE Yearbook traces six steps on the road from 
pure science research to established educational prac- 
tice. His third step, still classed as pure science re- 
search, states, “Research on learning that is relevant 
because the subjects are school-age children and the 
material learned is school subject matter or skill, 
though no attention is paid to adapting the learning 
to school practices.” A “system-free truth seeker” 
might operate at Hilgard’s third level and use the 
school as a kind of laboratory. Pupils, teachers, and 
administrators would be his experimental subjects 
as he seeks for truth and knowledge. As Hilgard 
states, “Of course there may be bridges from any 
pure-science project to a practical one: perhaps 
drugs discovered in brain studies of rats may aid 
remedial reading, studies of interference may suggest 
intervals between classes or what should be studied 



concomitantly, and language-vocabulary results in a 
pure context may guide language acquisition in 
schools. The main point is that the scientist has not 
committed himself to relevance.” 

Is the appropriate educational researcher for the 
public school setting one who does not commit him- 
self to relevance? Should we prepare a person to use 
the school as a laboratory in a search for truth and 
knowledge with the understanding that we expect no 
immediate utility from anything he does? Is a system- 
free truth seeker the kind of emerging research worker 
we should be preparing? I leave the answers to these 
questions to you, with one related point. Our new 
campus at the State University at Albany has nu- 
merous towers, ivory or otherwise. For those of us who 
dwell in these and similar towers there is great appeal 
to the idea of developing system-free truth seekers. We 
like to impress upon students that theory is important, 
that profound ideas may take years to become mean- 
ingful in terms of applications, and we may even 
subtly suggest that what is immediately practical is 
likely to be trivial. Perhaps what we in higher educa- 
tion like happens to coincide with what public schools 
need, but perhaps it doesn’t. An examination of other 
possible roles may help us to decide to what degree 
the emerging research worker should be a system-free 
truth seeker. 

A second possible role for the researcher in the pub- 
lic school is that of “educational accountant.” At pres- 
ent most schools can tell us more about the fuel oil 
that goes into the burner in the basement and the effi- 
ciency with which it is utilized than they can about 
the units of arithmetic taught in the third grade and 
its efficiency for pupils. Perhaps an educational re- 
searcher should be a kind of bookkeeper, skilled in 
maintaining precise records of inputs and outputs for 
each pupil in the school, and competent in letting us 
know just how the books balance. Let me attempt to 
illustrate more precisely what I mean. Suppose we 
should analyze the records available on a sixth grade 
boy whom we now call a “retarded reader.” We are 
likely to find an attendance record, a series of achieve- 
ment test scores, (but usually not the tests themselves) 
one or two intelligence test results, copies of reports 
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to parents, a capsule comment each year from the 
teacher, and perhaps the record of an hour or two 
that he spent with the school psychologist. This child 
has typically spent more than 7,000 hours of his life 
in school by the sixth grade. Do we really know 
enough about what has happened to him? Could tve 
develop a specialist who could provide us information 
about the specific instructional materials used with the 
child, the specific types of classroom climates to which 
the child has been exposed, the kinds of reinforce- 
ments the pupil has encountered, the cognitive styles 
which he has displayed in different learning situations, 
the mechanisms which he has used to handle frustra- 
tion, and the ways he has interacted with his peer 
group? The role that I see for the educational ac- 
countant is descriptive. He would provide a detailed 
picture of what goes into the education of each child, 
and what behavior comes out. Others in the educa- 
tional setting would use his data in developing pro- 
gram changes, in guiding the child, and in making 
various kinds of operational decisions. 

Perhaps the role that I have attempted to sketch for 
the educational accountant does not seem to you to 
really involve educational research. Please note that 
the role will demand the development and validation 
of much instrumentation and the use of many re- 
search-related skills. Perhaps the crucial question is 
whether a person playing the role I have described in 
the public school setting would be of sufficient value to 
justify his position. If so, do we know enough to train 
such a person, and is he the one we will call an 
“emerging research worker?” Again, let us consider 
some alternatives. 

A third kind of emerging research worker might be 
what I have chosen to call a “grant-getting go-be- 
tween.” All of us have been exposed to various public 
and private sources of money available merely for 
writing the proper proposal. We are also aware that 
many proposals written during the past year were de- 
veloped by professionals in the school with no special 
training and no special interest in developing research 
studies. Often these proposals involved good ideas and 
good procedures for carrying out the ideas, but did not 
provide adequate means of evaluation. Perhaps the 
emerging research worker should be an expert in 
knowing where research money is and how to get it. 
He might be the one who helps the school psy- 
chologist develop his proposal for the National In- 
stitute of Health, who works out the Title I proposal 
for elementary school guidance, or who finds founda- 
tion support for a new reading program. In each case 



the “grant getting go-between” would be working with 
specialists in the school to put their ideas into a re- 
searchable format and finding support for that format. 
To show that we in professional education really be- 
lieve in the free enterprise system, we might even pay 
our “grant-getting go-between” on a commission basis 
—perhaps three per cent of all grant monies from 
public sources and double pay for private money. 

At the moment at least, money is not the problem. 
Rather we need more rigorous evaluation of new edu- 
cational ideas than the criterion, “Parents seem to like 
it.” Perhaps the emerging researcher should be one 
who inserts a valid research element into rapidly de- 
veloping new programs so that in time we may Veally 
know the worth of these new programs. Is the “grant- 
getting go-between” the kind of researcher we should 
train for the public school? Again, let us consider 
another alternative. 

Perhaps our emerging research worker might be a 
“Foreign Language Interpreter and Translator— 
FLIT.” School people could then revive the old ad- 
vertising slogan, “Quick Henry! The Flit!” in a new 
context. To illustrate that, for many potential con- 
sumers, educational research reports are a kind of 
foreign language which requires translation, I selected 
a study with a simple sounding title which seemed 
relevant to the concerns of a public school teacher. 
The study, “Adolescents’ Acceptance of Authority,” 
appeared in the Harvard Educational Review in the 
summer issue of 1965. The author states in his con- 
clusion: 

Having conceived of authority as the acceptance of 
the justification of power relationships, we have found 
some evidence that, for a certain population of ado- 
lescents, such acceptance derives from commitments 
to distinguishable criteria. We conclude that subjects' 
verbal acceptance reveals criteria which have been 
formerly hypothesized by political and sociological 
theorists, but which have not been investigated in a 
“clinical” sense. This clinical application indicated 
that additional criteria might be needed to describe 
rationales which people use as vehicles to accept de- 
cision-making power (in the area of public con- 
troversy) . 

The differential frequency with which the criteria 
were invoked indicated more or less popular criteria 
within this adolescent sample. Correlations between 
the frequencies of the criteria suggested that some of 
the criteria are meaningfully related to each other in 
terms of familiar political and psychological observa- 
tions. 

“O.K., so what else is new?” the high school English 
teacher may ask. (In unguarded moments English 
teachers can be quite colloquial) “I’m having enough 




trouble with ‘Winston Tastes Good Like Your Cigar- 
ette Should’ and the symbolism in Macbeth to worry 
about jargon like, . . Correlations between the fre- 
quencies of the criteria. . .” 

This teacher needs FLIT— a person who can help 
to bridge the gap between research and practice by 
translating research findings into a language that can 
be understood by other professionals in the educa- 
tional setting. In my opinion, the study which I have 
quoted is a good one with possible implications for 
educational practice. However, such implications need 
to be translated from research findings before they 
have meaning, and this is the task I see for the Foreign 
Language Interpreter and Translator. Such a person 
might help to reduce the often lamented gap between 
research findings and application. 

The last role that I would like to consider for the 
emerging research worker is that of “public relations 
expert statistics spouter-PRESS.” This person would 
have at his fingertips facts and figures about the educa- 
tional enterprise which would be available for all 
kinds of press releases. He could show the PTA, with 
colorful graphs, why a new school building is neces- 
sary, convince the Board of the need for higher salary 



schedules, and demonstrate to the local John Birch 
Society that the citizenship education program is really 
effective. In this day and age of image building, 
PRESS could lend an air of scientific respectability to 

the school. 

I have suggested that the emerging research worker 
might be a system-free truth Seeker, an educational 
accountant, a grant-getting go-between, a foreign 
language interpreter and translator, or a public rela- 
tions expert statistics spouter. You may have other 
roles which you see for the emerging research worker. 
The important question is to determine what we really 
want such a person to do in the public school and then 
decide how we can best prepare him to do it. The 
“we” I have in mind for this decision-making is a 
joint “we” including public school personnel, state 
education department, and higher education. Deci- 
sions about function and role need to be made before 
we decide whether the emerging research worker 
needs teaching experience, courses in statistics, or work 
in public relations. 

It is my hope that groups such as ERANYS and 
convocations like this one may bring about a formal 
and an informal discussion which will bring us closer 
to needed decisions. 




THE EDUCATIONAL RESEARCHER : 
COMPUTER SCIENTIST OR RENAISSANCE MAN? 

John B. Carroll, Harvard University 



Among other things, life is full of assumptions, and 
I would like to begin by announcing one assumption 
about which I have a certain amount of doubt, but 
which it is necessary to make if I am going to get on with 
this talk— namely, that there is such a field as educa- 
tional research and that it has something useful to do 
other than to improve its own methodology. Several 
years ago I taught one of my graduate classes in edu- 
cational research to distinguish among several varieties 
of research: methodological, measurement, survey, cor- 
relational, and experimental treatment research. I 
then sent them to the library to classify articles in 
selected educational research j “ials. Nearly 50 per- 
cent of the articles scanned were of a purely method- 
ological character involving no empirical data,— deal- 
ing with such things as new statistical formulas, new 
methods of scoring tests, or new methods of computa- 
tion and data handling. Perhaps the situation has im- 
proved in the last few years, but at the time I was 
struck with the enormous fondness that educational 
researchers seemed to have for statistics and meth- 
odology; they were almost afraid to touch ground and 
get their hands dirty with data. Obviously, developing 
new methodologies and new statistical formulas is not 
going to change the world very much, nor even influ- 
ence the process of education, which I take to be the 
proper concern of educational research. 

Nowadays a new image of the ideal educational re- 
searcher is emerging in some quarters,— the image of 
him as a “computer scientist,”— a person who not only 
knows his educational research methodology and sta- 
tistics, but who is also skilled in programming com- 
puters to handle large quantities of data, to run edu- 
cational experiments “on line,” or to give “computer 
aid” to instruction. (That phrase, “computer aided 
instruction makes me wonder sometimes whether the 
computer is giving first aid to something that is in 
emergency need of repair!) Let me hasten to say that 
many of the new developments in research method- 
ology, statistics, measurements, computer aided in- 
struction, data banking, systems analysis, simulation 
techniques, and so forth are promising, and may pay 



off in the long run. I have felt it important to en- 
courage and actually participate in some of these de- 
velopments. It is clearly necessary for the science of 
educational research to perfect its methodology and its 
tools,— both of the soft and the hard varieties. There 
has been strong reason for the new breed of educa- 
tional researchers to develop themselves toward the 
image of the computer scientist I have been depicting. 

When I say “computer scientist,” I use this phrase 
only as a shorthand label, as it were, for a wide class 
of educational research specialists. Not all of those I 
refer to in this way are necessarily computer scientists 
in the strict sense; some of them will never get near a 
computer or even an IBM card— except on receiving a 
Treasury Department check for reviewing Office of 
Education proposals. My phrase connotes the hard- 
nosed methodologists, the statistician, the test maker, 
the “measurement man,” the specialist in educational 
evaluation, the mathematical modelmaker, the spe- 
cialist in audiovisual technology or instrumentation, 
the decision theorist, or the systems analyst. As educa- 
tional psychology develops, we will undoubtedly see 
more subspecialties of “computer science” in educa- 
tion emerging. This is all to the good; practitioners of 
these subspecialties can make important contributions 
to education. 

The development of educational research and tech- 
nology through computer science and allied method- 
ologies has its distinct limitations, however. 

One of these is the rather well known and much dis- 
cussed fact that there are limits to what can be done 
widi exact and highly controlled experimental design 
in the schools. A Laboratory of Experimental Design 
has been established at the School of Education at the 
University of Wisconsin, but we have yet to see any 
major educational or instructional question that has 
been treated successfully by the techniques so well de- 
veloped by that Laboratory. When one contemplates 
research on a major question, like how language lab- 
oratories should be used in foreign language instruc- 
tion, or under what conditions homogeneous grouping 
is superior to heterogeneous grouping, or in what way 
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class size is a critical factor in instruction, he is faced 
with so many difficulties and necessary compromises 
in applying classical Fisherian experimental design 
that the effort seems hardly worthwhile. But this very 
limitation of highly controlled experimental design 
leads to a paradox: the person who tries any kind of 
educational research at all,— even though unavoidable 
circumstances may prevent it from going by the book, 
—needs to be acutely aware of the technical subtleties 
of experimental design and the possible threats to in- 
ternal and external validity so that he at least knows 
what controls he is failing to employ and what am- 
biguities in interpretation lurk in his research plans. 

But highly sophisticated research employing exact 
experimental design ^nd carefully validated measure- 
ments has an even graver limitation, and this one is 
inherent in it,— namely, the fact that even the best 
experimental design is only a tool for testing good 
ideas; it cannot create ideas of any sort, except insofar 
as its results may suggest good ideas to the mind of the 
researcher. The good ideas must come from some- 
where. Often they come from educational practitioners 
who have no idea of educational research design. 
Sometimes they come from theoreticians who may or 
may not be educational research specialists. But they 
rarely come from people who are purely methodolo- 
gists or “computer scientists.” The educational re- 
searcher who conforms too closely to the ideal of the 
“computer scientist” runs the risk of being written off 
as a pure technician, somewhat analogous to the "para- 
medical specialist” who is ancillary to the physician. 

Furthermore, even when educational research of a 
sophisticated character is testing a great idea, the dull 
statistical tables that result have little public relations 
value or power to move men. Jerome Bruner’s purple 
passages in The Process of Education , bereft of any 
suggestion of statistical technology, have had much 
more influence on the course of education than his 
more detailed and carefully designed studies of think- 
ing processes. Even the recent study of differential 
“educational opportunity,” ordered by Act of Con- 
gress and conducted with enormous sophistication in 
sampling design and educational measurement tech- 
nology by a group under the direction of James Cole- 
man, will probably not have its full impact until its 
findings can be translated into a book with the emo- 
tional power of, say, Rachel Carson’s Silent Spring. 
(This would be a wonderful project for some gifted 
writer, wouldn’t it?) Under the best of conditions, 
scientific educational research is difficult to convert 
into statements that can be useful to the educational 



practitioner and that will also move him to action. 

These and other considerations yet unmentioned 
lead me to suppose that the educational researcher in 
the guise of a computer scientist is likely to be a 
rather ineffective arid, in the long run, frustrated char- 
acter. He will not have the impact on education that 
he or we may desire. How can he improve his position? 
My answer, as you may have already divined, is im- 
plicit in the title of this talk: he must become a Ren- 
aissance Man. Before you conclude that all educational 
researchers must become Leonardo da Vincis, let me 
say that again I am using a phrase not as an exact 
description, but as a symbol for a concept. The Ren- 
aissance Man is not only a technician and a methodo- 
gist; he is also a broadly trained scientist;— and not 
only that,— he is a humanist who appreciates and un- 
derstands, to a considerable depth, the whole spectrum 
of human knowledge. In short, he has a sound liberal 
education in addition to his technical training. A 
modern Leonardo da Vinci might be the model or the 
ideal for our Renaissance Man qua educational re- 
searcher, but we cannot expect such versatility and 
competence in very many. Nevertheless, the require- 
ments I have in mind are high and demanding. Con- 
sider some details of these requirements. 

First, the educational researcher who approaches the 
ideal must be a practical man of sorts. He must have 
a familiarity with schools and their problems that he 
cannot acquire merely by a few desultory visits. He 
must be able to see the problems of the school at least 
partly from the standpoint of the teacher or the educa- 
tional administrator. He must be able to formulate 
educational research that will be realistic in terms of 
the practicalities of running schools. He must under- 
stand and get along well with school people in order 
to gain entree for his surveys and experiments. He 
must have some knowledge of the politics of education 
and the strategies and tactics of introducing educa- 
tional improvements. (I was about to use the fash- 
ionable term “innovations,” but I would be prejudiced 
against an innovation unless it is indeed an improve- 
ment: and the sad fact is that there are many innova- 
tions that are not improvements, and many possible 
improvements that are not innovations, but have been 
waiting around for decades.) 

Secondly, the educational researcher who ap- 
proaches my ideal of the Renaissance Man must have 
an intelligent understanding of the whole realm of 
curriculum as taught in the school. If he is going to do 
research on the teaching of the “New Math” or the 
“New Science” or the “New English” (and I don’t 
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mean the New England dialect!) , he has got to under- 
stand the goals of these new curricula and be able to 
communicate with their purveyors without making 
himself appear silly or otherwise unacceptable to them. 
This requires a considerable degree of mental flexi- 
bility and willingness to give up old modes of think- 
ing. It is hard enough for teachers of mathematics, 
science, or English to learn new ways of thinking 
about their subject matter; it is even harder for the 
educational researcher, who approaches these subject 
matters from the outside, so to speak, to do this. It is 
all too easy for the test maker or curriculum researcher 
stubbornly to insist upon the sublime propriety of 
what he was taught or the way he was taught, 20 or 
30 years before, rejecting the new wisdom of the cur- 
riculum developer. For example, an educational re- 
searcher who had experienced only the traditional 
methods of teaching English grammar would fail to 
comprehend contemporary thinking in this field and 
would probably be unable to perform meaningful re- 
search in it, even though otherwise he might even- 
tually be able, let us suppose, to show a superiority for 
the traditional method over methods being promoted 
currently. 

Thirdly, the educational researcher nowadays must 
be not only a methodologist, but also to a large extent 
a behavioral scientist. Because his research deals with 
changing human behavior, he has got to have a deep 
knowledge of theory and research in those aspects of 
behavioral science that can help him in this task. 
Sociology, anthropology, political science, economics, 
and even history may be useful to him, but above all, 
I think, psychology,— because the educational process 
is concerned centrally with the individual rather than 
the group. And within psychology, the most useful 
knowledge probably comes from research on learning, 
motivation, attention, maturation, and other basic 
topics. It is not without reason that a large number of 
educational researchers have a primary affiliation with 
psychology. I do not insist that the educational re- 
searcher be a productive scholar in a behavioral sci- 
ence; his use of behavioral science is more generally 
in application than irrdiscovery. Nevertheless, many 
of the most distinguished educational researchers, like 
E. L. Thorndike, have made genuinely creative con- 
tributions to a behavioral science. Because behavior 
theory still seems so inadequate in its application to 
education, and because the prime application of be- 
havior theory would seem logically to fall within edu- 
cation, it behooves the educational researcher to think 
twice before deciding not to engage, at least to some 



extent, in fundamental research in behavioral science. 

Fourthly, the educational researcher who emulates 
the Renaissance Man must be a creator or an inventor 
in a sense beyond mere productive scholarship. He 
must create new educational ideas, to be tested by his 
methodology, and guided by his research. He must 
invent new educational materials and techniques to be 
tried out in the schools and colleges. With his knowl- 
edge of the practical problems of education, of cur- 
ricular trends, and of the principal theories and results 
of behavioral science, he has at least as good an op- 
portunity as anyone else to initiate new and useful 
educational proposals. If he is also an essentially crea- 
tive person, whatever that may mean or entail, educa- 
tion will be that much the gainer. 

And fifth, I should like my Renaissance man-educa- 
tional researcher to have a flair for communicating his 
ideas and findings in speech and writing in such a way 
that they can gain the wide audience that they need 
to gain if educational research is to have its rightful 
place in the scheme of educational progress. It is all 
very well for him to pile up an impressive number of 
research publications reporting empirical findings in 
the manner approved for the Journal of Educational 
Psychology or the American Educational Research 
Journal, but there is also a place for the thoughtful, 
inspiring public address or printed essay that will 
reach the minds of teachers, curriculum supervisors, 
school administrators, or the lay public. The require- 
ment is not that he be a literary genius; he needs only 
to be capable of clear thought expressed in an interest- 
ing and imaginative expository style. 

These, then, are my modest minimum requirements 
for a Renaissance type of educational researcher. I re- 
mind you that earlier I said he must also have a strong 
streak of the computer scientist in him. Beyond this 
he is a free man! He may make his own choices about 
cars, clothes, beards, marriage, politics, religion,— and 
the ways he would spend his leisure time if he had 
any! 

You may say the ideal I’ve depicted is an impossible 
combination of almost incompatible skills, knowl- 
edges, and talents, or that it would take a lifetime of 
training to produce such a person. Renaissance Men, 
you may say, were possible in the Renaissance, but not 
today. I will grant that the standard is high and that 
the educational researcher who approaches it will be, 
at least for the time being, a rarity. Further, I grant 
that the time required to produce a really competent 
educational researcher is long, but probably it is no 
longer than the time required to produce real com- 



petence in any other professional field. This is simply 
something that we must reckon with and plan for, bet- 
ter than we have in the past. I would like to state some 
of my thoughts on the selection and training of educa- 
tional researchers. 

Obviously, a central requirement is high intelli- 
gence and high aspiration. Among the millions of un- 
degraduates in our colleges today there must surely be 
a sizable number of topnotch students who might be 
attracted to educational research rather than to nu- 
clear physics, international politics, or what have you, 
provided the potential rewards and satisfactions of 
excellence in creative educational research were made 
known to them. A surprising number of outstanding 
educational research workers of my acquaintance to- 
day had undergraduate majors in physical or biologi- 
cal sciences. This is borne out by Bargar’s survey of 
educational researchers, which found that 14.2 percent 
of 3737 respondents had undergraduate majors in 
these two sciences. 1 But Bargar also found that 37.8 
percent of his respondents had undergraduate majors 
in psychology, sociology, or other social sciences, and, I 
suppose, these are the fields where we would be most 
likely to find candidates for advanced training in edu- 
cational research. What we would have to be most 
careful about, however, is the danger that out of all 
the potential candidates, educational research would 
attract only the less able,— the ones who might think 
of education and educational research as a “soft" kind 
of work, not as challenging as pure academic research 
in a discipline like mathematics, psychology or chem- 
istry. 

But while we are considering the undergraduate 
phases of the development of an educational re- 
searcher, let me plead for breadth of study,— that is, 
for a liberal education in all branches of knowledge. 
It is in this period, supplementing a good secondary 
education, that the prospective educational researcher 
can acquire knowledge of subject matters that he will 
need when, later, he undertakes research in the teach- 
ing of one or other of these disciplines. The study of 
mathematics, statistics, and science are obviously basic 
to his later involvement in research methodology. 
Probably he should acquire a considerable competence 
in one or two foreign languages, chosen among French, 
German, and Russian, because of the increasing im- 
portance of educational research publications in those 
languages and the increasingly international look of 

1 Bargar, Robert R. Who is the educational researcher? Pp. 
13*47 in Guba, Egon, and Elam. Stanley (Eds.) , The training 
and nurture of educational researchers. Bloomington, Indiana: 
Phi Delta Kappa, 1965. 



educational research. And he would need to be well 
grounded in literature, art, and philosophy, because 
the humanistic areas are so important in the school 
curriculum. A major or a minor in a behavioral sci- 
ence would be a desideratum but not a necessity. I see 
little reason, however, for him to study education at 
die undergraduate level, except possibly one course in 
educational psychology or the history of education, 
taken as an elective. 

An excellent plan for the first year of graduate study 
might be one spent in preparation to be a teacher,— as 
in one of die many MA in Teaching programs that 
now dot the academic countryside, followed by a year 
of actual teaching. Alternatively, the student might 
spend two years in some sort of work such as teaching 
in the Peace Corps or the job Corps. The period im- 
mediately after the undergraduate years would be a 
good time to acquire teaching experience unencum- 
bered by the doubts and qualms that would be en- 
gendered by later graduate study, and my prescription 
for the Renaissance Man-educational researcher cer- 
tainly requires some teaching experience. But there 
are two dangers in planning teaching experience at 
an early stage after the bachelor’s degree: one, the stu- 
dent may lose continuity between his undergraduate 
study and his later, advanced graduate studies, and 
two, there will be a certain number of people who may 
not stand up to the rigors of early teaching experience 
even though they could later qualify as outstanding 
educational researchers. It would be a pity to lose 
these people on their way to the educational research 
profession. 

On his return to graduate study after a stint of prac- 
tical teaching experience, the prospective educational 
researcher must, I am afraid, be prepared for a fairly 
lengthy and arduous course lasting 3 or 4 years before 
obtaining the doctorate. Normally the training will be 
in one of the behavioral sciences, but with a consider- 
able infusion of courses in education: philosophy of 
education, curriculum development, educational ad- 
ministration, counseling and guidance, teacher super- 
vision, principles of teaching, and the teaching of se- 
lected subjects in the curriculum. If the spedalization 
is in educational psychology, there must be a heavy 
concentration of courses and readings in various as- 
pects of that subject, and of course, in any case, there 
must be a firm mastery of some of the more advanced 
and esoteric aspects of educational research methodol- 
ogy, including experimental design, multivariate statis- 
tics, theory of measurement, and the like. The “com- 
puter scientist” streak of the Renaissance Man must be 
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nourished with courses and practical experience in 
computer programming and computer aided instruc- 
tion. 

Towards the end of the trainings, the student must 
be introduced to actual educational research work on 
an apprenticeship basis, working as a project assistant. 
But he should be encouraged to strike out on his own, 
still under supervision, of course, to the point of de- 
veloping research material publishable under his own 
name. 

The course of training should include lectures, read- 
ings, and practical work on the organization and ad- 
ministration of educational research, including the su- 
pervision of research staffs, the preparation of project 
proposals and budgets, and “grantsmanship” in gen- 
eral. Similarly, there should be supervised work on 
curriculum development and evaluation or some other 
grassroots kind of problem. 

I would insist that there be a dissertation that would 
constitute an original piece of educational research, 
either as an independent project or as part of a larger 
project. It would be a contradiction for an educational 
researcher to obtain his doctor’s degree without per- 
forming educational research. 

To round out the training of the educational re- 
searcher, I would strongly urge that post-doctoral 
research experience, again under supervision, be a 
normal and expected part of the researcher’s career. 
Usually he would take his post-doctoral training at a 



university or research bureau other than the one from 
which he had received his doctorate, in order that a 
different staff could inject him with fresh ideas. 

Such a background would go far, I think, to pro- 
duce the Renaissance Man that is my ideal. It is only 
a logical extension of some programs that are already 
in operation. At the same time, I have emphasized 
throughout that the standards must be set high and 
that the training period must be lengthy. My aim has 
been to show that actually the requirements for the 
training of the effective educational researcher are 
perhaps higher and more demanding than they are for 
most other types of specialists. I think, for example, 
that they are higher than for the normal Ph.D. in 
psychology. Failure to recognize this fact has plagued 
the field of educational research because it has resulted 
in inadequate planning for pre-doctoral and post- 
doctoral fellowships, research assistantships, and the 
like. As another consequence, we have turned out too 
many research personnel who are very far from being 
Renaissance Men;— either they have been strictly com- 
puter scientists and methodologists, or they have been 
insufficiently trained and ineffectively operating gen- 
eralists. This is responsible for the poor and unexcit- 
ing quality of a great deal of educational research: 
poorly conceived, poorly designed, poorly performed, 
and poorly reported. It is no wonder that educational 
research has been in bad repute. 

Let us, therefore, try to train more Renaissance Men 
in educational research. 
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Highlights of 
Recent Research 



SELECTED STUDIES IN ADMINISTRATION: 
RECENT RESEARCH IN THREE SOCIAL SCIENCE DIMENSIONS 

Laurence Iannaccone, Frank W. Lutz, & Harry J. Hartley, New York University 



This paper has two main purposes. One is to iden- 
tify some of the theory based research in educational 
administration, recently done, now underway, or pre- 
dictably to be undertaken soon. Its second purpose is, 
chiefly by way of illustration, to depict the process by 

which theorv based research contributions come to be 
* 

made and eventually have an impact on the training 
of educational administrators. Research in selected 
aspects of three social sciences applied to the study of 
educational administration will provide the vehicle for 
illustration. 

A process which we shall inaccurately dignify be- 
yond its merits as philosophizing about specific prob- 
lem areas in educational administration seems to take 
place first. Then some loose historical studies, some 
more or less— usually less— theory based descriptive 
work, and much more census taking called research 
takes place. If the problem area continues to evoke 
interest, conferences of professors frequently talking 
about the need for theory based research and the po- 
tential contribution of the social sciences may overlap 
and follow the census taking and descriptive work. 
Sometimes worthwhile theorizing goes on at a few of 
these. In the meantime, bright graduate students not 
invited to the conferences may, one here, one there, 
begin to produce theory based research in the area. If 
these dissertations begin to cluster around a few schol- 
ars, as in even a single college department of admin- 
istration, the move to somewhat larger theory 
grounded research programs may begin. This may take 
place if one or more of the graduate students doing a 
theory based dissertation becomes a research professor 
and with his student follows up his dissertation. At 
such places the introduction of new courses and pro- 
gram revision in educational administration may be- 
gin. At any one of these points or stages the develop- 
ment may, however, stop due to a wide variety of 
factors including chance areas. 

The area of research on teacher organization and 
negotiation has been selected to illustrate the first 
phase of this process as it is now being approached 
with sociological theory which is beginning to produce 
theory based research. 



The Sociological Dimension, Research On 
Teacher Unions and Associations 

The field of teacher negotiations is too new to have 
produced much research. Unfortunately, work done in 
the public and private sectors is not directly applicable 
to teacher groups. Considerable attention has been 
given to the area of public employees with emphasis 
on civil service, Federal, State and local. A recent book 
by Walton and McKersie 1 has developed an extensive 
theoretical analysis of the negotiation process. This 
work is generally pointed at the private sector. Its 
theoretical base rests largely in psychology, and little 
research in the actual operation of unions is incor- 
porated. 

Because of recent problems in educational admin- 
istration, there has developed a considerable writing 
on the subject. Some of the writers are not new to 
the area. Myron Lieberman 2 produced his first bock in 
1956. His work has contributed to what might be 
called the “philosophical discourse” but has provided 
little generalizable knowledge about teacher militancy. 
In general, most of the work published in the journals 
of the profession has furthered this philosophic dia- 
logue or described the present status of the situation. 
In addition, journal articles and National Education 
Association "research” have contributed to the “social 
census taking” in the area. Thus, data are available 
that give the number of associations and union mem- 
bers, the number of written contracts and agreements, 
and the kinds and extent of sanctions and strikes, etc. 
Two recent books, one from the association point of 
view, 3 the other somewhat broader, 4 describe in an 
atheoretical way the present status of the field. 
Another book that calls upon the collective knowledge 
of six persons in different disciplines attempts to de- 
velop theory that might explain the behavior of teach- 

i Richard E. Walton and Robert B. McKersie, A Behavioral 
Theory of Labor Negotiations , (New York: McGraw-Hill Book 
Co., 1965.) 

i Myron Lieberman, Education as a Profession , (Englewood 
Cliffs, New Jersey: Prentice-Hall, 1956.) 

ST. M. Stcnnett, Jack H. Kleinmann and Martha L. Ware, 
Professional Negotiations in Education , (New York: The Mac- 
millan Co. Limited, 1966.) 

4 Myron Lieberman and Michael H. Moskow, Collective Ne- 
gotiations for Teachers , (Chicago: Rand McNally and Co., 1966.) 
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ers and teacher groups in the present administrative 
and organizational setting® While this last volume 
provides an attempt to utilize theory in understanding 
the problem of teacher power, little research is dted 
except as related to state politics. 

Perhaps the most systematic research done in this 
area has been done by Wesley A. Wildman and his 
associates at the University of Chicago.® Again, this 
cannot be called theoretical research. It focuses heav- 
ily on the legal aspects of the situation and on a de- 
scriptive presentation of what exists. 

Conferences across the country have also used this 
area as a point of emphasis. Excluding the local, and 
county meetings, one can point to the conferences held 
at the Universities of Rhode Island, Indiana, Arkan- 
sas, Pennsylvania, Oklahoma, and New York Uni- 
versity. These last two meetings resulted in publica- 
tions that include some theoretical approaches, but 
little research . 7 Undoubtedly these efforts at theorizing 
and the recent work of sociologists in industry such as 
Blau, Etzioni, Gouldner, etc., will result in theory ori- 
ented study in this area in the near future. As for now, 
the shelf is nearly bare. 

Presently most of the theoretically based research 
concerned, with teacher unions or associations has been 
done by doctoral candidates with the result that once 
done, little dissemination occurs. Ralph Schmid 8 
studied the historical aspects of the NEA as the AASA, 
the teachers union, and the classroom teachers’ associa- 
tion struggled for the reins of leadership. Steven Ru- 
bin® interested in the effect of spacial change on the 
sentiments of individuals within the informal struc- 
ture of the elementary school, studied the sentiment 
change toward a teacher union. Seymour Evans 10 
studied the organization of schools in relation to bu- 
reaucratic theory and found that the predisposition of 
teachers, along a Gemeinschoft-Gesellschoft con- 
tinuum, was related to their tendency to seek oiganiza- 
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tion along a bureaucratic-prebureaucratic continuum. 
This he notes is related to the tendency toward union 
militancy or loose association. Other doctoral research 
could be cited. These three only serve as indicators of 
the possibility of theory related research in this area. 

Underway at the present time are some interesting 
research projects which indicate an attempt to study 
this area of educational administration. A project 
funded by the Center for Urban Education is looking 
at the possibility that Gduldner’s bureaucratic sanc- 
tion model can account for principal leadership be- 
havior in schools operating under union contracts. 
Another study, an outgrowth of Evans’ work, is at- 
tempting to test the hypothesis that teacher member- 
ship is related to Gemeinschoft-Gesellschoft predis- 
positions and organizational pressure. Two other 
studies are looking at the role of the superintendent 
in negotiations: one uses role as a dependent variable 
related to the independent variables of district conflict 
and size; the other uses role, along with district size 
and fiscal structure, as independent variables related 
to board, superintendent, and teacher satisfactions 
with the negotiation process in the district. All of 
these projects are related to a central research theme 
at New York University and should result in inte- 
grated systematic theory building in an area of edu- 
cation. 

Finally, it may be noted that this summer a work- 
shop will be taught by Evans on the principal’s role. 

Attention will next be given to the political dimen- 
sion focusing on recent research in the state politics 
of education and emphasizing the later stages of the 
process, the theory based research program, and its 
diffusion through program changes in the training of 
school administrators. 



...« ainio roimcs ot Educatic 

Following some of the early phase philosopher 
about politics— "t'is—"t’ain’t'' in education, a numb, 
Of atheoretical descriptive studies were produced o 
the politics of education at the state level . 11 As ind 
cated at the outset of this paper, these need not nece 
sanly have resulted in theory and theory based r< 
search. They were, however, not only widely read, bi 
also studied and at one institution, at least, they fun< 
tioned as the basis for a four semester sequence of r< 
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search seminars in the politics of education. This se- 
quence in turn produced theory in the state legislative 
politics of education, 12 publication of this and theory 
based research in the form of dissertations on the state 
of California’s politics of education. 

The earlier descriptive studies were treated by post 
factum analyses. Out of this emerged a typology based 
upon characteristics of ihe organizational structure dis- 
played at the key linkage point and a model of the 
prevailing pattern of state educational politics. 13 Sub- 
sequently, the taxonomy was refined into a develop- 
mental construct. A diagrammatic representation of 
the developmental construct follows: 



fornia. 14 These, in turn, partly tested the utility of the 
construct and elaborated it. Finally, courses in the 
politics of education influenced by this work exist at 
the Claremont Graduate School, Auburn University, 
the University of Wisconsin and New York University. 

A similar process may be seen at the local district 
level with respect to the politics of education. De- 
scriptive work by Lutz, 15 followed by theoretical elab- 
oration using other works in local government led to 
theory related to political change resulting in speci- 
fiable patterns of superintendent turnover and succes- 
sion. 10 These verificational studies involving in all 161 
school districts, provided tests of hypotheses derived 
from the theory. In turn, this work now influences the 
courses cited earlier and hence, the training of future 
school administrators. 



A Developmental Construct of The State 
Politics of Education 
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Phase two 


Phase three 
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1. Structure 
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Development, over time 




Statewide general political reorganization 



This became the basis of a series of longitudinal 
studies on the State politics of education in Cali- 



u Laurence lannacconc, The Future of State Politics of Educa - 
lion, Frank W. Lutz and Joseph J. Azzarelli eds. in The Struggle 
for Power in Education (New York: The Center for Applied Re- 
search in Education, Inc. 1966.) 

13 Laurence lannaccone, The State Politics of Education in a 
publication of the Center for Research and Leadership Develop- 
ment in Vocational and Technical Education, (The Ohio State 
University, forthcoming.) 



m Among which see, B. Dean Bowles, Conflict and Consensus 
in the State Politics of Education; Donald N. Mclsaac, A Sta- 
tistical Analysis of the State Legislature in California; W. Deane 
Wiley, Political Interaction of Education and the California 
Legislature: 1849-1963; (Unpublished Ph.D. dissertations, The 
Claremont Graduate School, 1966.) 

15 Frank W. Lutz, Social Systems and School Districts, a Study 
of Sentiment and Interaction of a School Board, (Unpublished 
Ed.D. dissertation, Washington University, 1962.) 

’‘Robert M. Freeborn, School Board Changes and Involuntary 
Turnover; Richard S. Kirkendall, Discrimmating Social, Eco- 
nomic and Political Characteristics of Changing vs. Stable Policy- 
Making Systems in School Districts; Eldon G. Shafer, Unification: 
A Change of Power Structure Reflected in Board Composition 
and Superintendent Selection; John C. Walden, School Board 
Changes and Involuntary Superintendent Turnover. (Unpub- 
lished Ph.D. dissertations, The Claremont Graduate School, 
1966.) 
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The next dimension, the economic, raises an inter- 
esting question. Of the three dimensions, it should 
logically have had the greatest impact already, because 
it is a social science more detailed, specific, and the- 
oretical than the other two and yet its potential con- 
tributions to educational administration have yet to 

be well exploited. But a beginning has been made 
here too. 

The Economic Dimension 

A school may be conceived as an economic system, 
as well as a social or political system, for we are merely 
examining the same structure with different analytical 
tools. Recent published scholarship in this area of 
educational economics indicates that this discipline 
can contribute to theoretical construct development 
and research in school administration. Of all the social 
science disciplines, economics appears to possess the 
most highly developed theoretical structure. Economic 
rationality incorporated mathematics and systems 
analysis techniques as a means for relating measure- 
ments research to decision making. The discussion 
which follows contains a brief description of three 
economic concepts which may be applied to admin- 
istrative research; systems analysis, program budgeting 
and economic value dimensions. ° 

Systems Analysis 

A topic of central concern to both economists and 
administrators is optimum allocation of scarce re- 
sources. Economics provides consistent, inclusive 
theories of decision making under which allocation 
problems can be restated in system analysis terms and 
techniques. The purpose of systems analysis is to im- 
prove methods of decision making. Maccia 17 developed 
guidelines for research involving this concept in edu- 
cation, although the Rand Corporation provided 
earlier data. In reviewing the research literature on 
systems analysis, one may encounter similar, yet tech- 
nically different, terms such as operations research, 
input-output analysis, management information sys- 
tem, program evaluation, cost-benefits analysis, and 
others. Prest and Turvey compiled an extensive bibli- 
ography of current research,™ particularly involving 
cost-benefits analysis. Thomas is currently conducting 
research in probability models and systems analysis 



w George S. Maccia, An Educational Theory Model: General 
Systems Theory , Occasional Paper 62-126 (Columbus: Bureau of 
Educational Research and Service, Ohio State University, 1962.1 
' ,f pre8t an< ? R - Turvey, “Cost-Benefits Analysis: A Sur- 
E mtC Journal > vo1 - LXXV, December, 1965, pp. 



design for education at the University of Chicago.™ 
The implications of a systems approach are great, and 
research interests in this area are only beginning to 
expand. ° 

Program Budgeting 

The major characteristic of a typical school budget 
is its incremental nature. This year’s budget, for ex- 
ample, possesses the same structure as last year’s, ex- 
cept that it may contain five percent increases in the 
various line-items. Little attempt is made to evaluate 
the various programs which are supported by the 
budget. A budget is almost never reviewed as a whole 
each year in the sense of reconsidering the value of all 
existing programs. On the other hand, the program 
budget, which has been successfully applied to the 
Federal Government by Defense Secretary McNamara, 
is organized in terms of program elements that pro- 
duce designated end-products, rather than a line-item, 
object basis. Costs are continually analyzed in rela- 
tion to the measurable benefits produced by the pro- 
gram elements. Certain municipal governments such 
as Los Angeles and New York’s Nassau County and 
major school districts such as Chicago, Memphis, and 
Dade County, Florida are conducting research to de- 
termine how to implement the program budget. In a 
major 1966 study of more than 100 large city school 
systems, James of Stanford concluded, “It is likely that 
the use of program budgeting will slowly increase in 
large city school systems during the coming decade.” 20 
James also noted that Title I of the Elementary and 
Secondary Education Act of 1965 places specific evalua- 
tion requirements upon local districts which involve 
cost-benefits analyses and program budget-related in- 
formation. 



economic Venue in Education 

This rather global topic includes diverse types of 
research of which three contrasting examples are men- 
tioned: productivity, individual value preferences, and 
human capital. 

1) Productivity: Education is a major determinant 
of productivity increases and economic growth in this 
country. Productivity indexes, which consist of a ratio 
of the quantity of goods produced to the input of costs 
have been developed for various industries, but there 

’»J- Alan Thomas, Probability Models and Computer 
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exists no such index in education at die present time. 
Benson focused upon studies of educational produc- 
tivity measures. 21 Beginning with the premise that 
education is handicapped by not being able to relate 
changes in dollar value of inputs to some series of out- 
puts, he concluded that some forms of partial measure- 
ment may be suitable. Thus, not all of the output of a 
school must be stated in quantitative terms. As indexes 
of educational productivity are refined, more precise 
justification for increased expenditures on education 
can be given. For example, increased spending could 
be defended in terms of the higher yield of products 
that die dollars provide.' 

2) Individual Value Preferences: Economic anal- 
ysis can be of help to educational leaders who are 
searching for explanations which underlie the be- 
havior of those who provide the financial support for 
public education. Economics treats the motivating fac- 
tors of human activity as economic motives, and pro- 
vides explanations for the phenomenon of human be- 
havior. One indication of value preferences is die 
extent to which taxpayers vote for or against referen- 
dums for school budgets, bond issues, building ap- 
proval, and acquisition of sites. In an exploratory 
study, Hartley analyzed ten value dimensions which 
eventually may be incorporated into a general eco- 
nomic theory of educational value. 22 One possible im- 
plication is that patterns of taxpayer behavior may be 
modified in the direction of a “core” system of positive 
educational values after researchers are better able to 
assess factors which influence an individual’s pro- 
pensity to consume public education. 

3) Human Capital: Economists and educational fi- 
nance researchers are directing greater attention to the 
extent to which man invests in himself. We know that 
a society can make investments in the productive ca- 
pacity of men as well as machines, but until recently, 
the very thought of investment in human beings as 
capital goods was rather offensive to certain people. 



21 Charles S. Benson, The School and the Economic System. 
Chicago: Science Research Associate, Inc., 1966. 

22 Harry J. Hartley, “Towards a General Economic Theory of 
Educational Value,” Educational Administration Quarterly, Vol. 
II, No. 2, Spring, 1966. 



Schultz conducted pioneer work which has reached a 
stage in which a quantitative basis has been laid for 
the validation of the view that the principal cause of 
American productivity and growth lies in the large 
and continuous rate of investment in education. 23 In 
this “human capital” approach, human beings are con- 
ceived as capital assets, or wealth, or resources. As an 
asset, a person is able to invest in himself and to ob- 
tain a measurable yield. A most important form of 
human investment is education, and the yield, or re- 
turn, on educational investment is quite high. A part 
of this yield cannot be expressed in dollar terms, but 
for the part that can be quantified, mathematical 
models are being developed. As a result, we know that 
human capital has been increasing at a rate substan- 
tially greater than reproducible (nonhuman) capital. 
One implication of this research is that it provides 
economic justification for additional governmental 
support for education. 

Conclusion: Economics has mudi to contribute to 
education. It is a science which studies human be- 
havior as a relationship between ends and scarce 
means which have alternative uses. If the ends are 
represented by educational excellence generally, and 
administrative excellence, specifically, then the appli- 
cation of economic theory becomes essential. The sev- 
eral concepts discussed above provide at least partial 
evidence of the extent to which economic research can 
be applied to educational administration. 

This brief review of three dimensions contributing 
in a small but significant way to research and training 
in educational administration suggest two things to 
us. The use of the social sciences in the study of edu- 
cational administration can no longer be considered 
a passing phase. The future contributions of these 
three dimensions: sociological, political, and economic 
will be much greater than at present, perhaps even 
greater than the present authors know. 



22 Theodore W. Schultz, The Economic Value of Education. 
(New York: Columbia University Press, 1963.) 
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HIGHLIGHTS OF RECENT RESEARCH IN BAYESIAN STATISTICS 

Donald L. Meyer, Syracuse University 



I am restricting this paper to the field of Bayesian 
statistics and indicating some of the interesting prob- 
lems which have been, and are currently being re- 
searched in this field. 6 

For those of you who are unfamiliar with the Baye- 
sian model, let me do a minute or so of teaching to 
acquaint you with the method. Bayes’ theorem states 
lat t e probability density of a parameter © con- 
ditiona on i data X is proportional to the uncondi- 
tional distribution or e multiplied by the likelihood 

of the data conditional on 0 
or; f (©1 x) oc f, ( 0 ) f 2 (xle) 

There is no disagreement as to the validity of the 
theorem. What is argued is its application. In fact, the 
way in which I stated the theorem might be objection- 
able to some people because I am implying that a 
parameter is a fandom variable, i.e., that it has a prob- 
ability distribution. For most problems in education, 
the statistical theory many of us have studied (Nev- 
man-Pearson or Fisher) treats parameters as fixed con- 
stants. The only random variables are those which are 
functions of the sample. 

The Bayesian really wouldn’t disagree with this ex- 
cept that he finds it reasonable and useful to think of 
his degree of belief regarding unknown parameters. 

The f (©) m the theorem represents the distribution 
of belief about sets of values of the unknown para- 
meter. This thinking is not too much different from 

, ,n which P eo P le interpret confidence inter- 
vals. When we say we are .95 confident that the limits, 

Ll a " d 7’ ,ndude the true value of the parameter, it 
is difficult to think of any useful interpretation other 
than that based on degree of belief or credibility. Re- 
ca , however, that m the Neyinan-Pearson theory, 
there is no foundation for such an interpretation. 

A Bayesian analysis, then, begins with the prior dis- 
tribution of «=> and ends with a description of the 
posterior distribution. Everything relevant about e 
is contained m the posterior distribution. Various sum- 
mary measures might be calculated and reported such 
as the mean-used as a point estimate-or intervals- 
used as interval estimates. 



Much of the past and current research is concerned 
with the derivation of posterior distributions for va- 
nous prior distributions and various sampling designs 
The exciting result is that the classical confidence in- 
tervals, tests, etc., are derivable from a fairly restricted 
c ass of prior distributions. This class is such that the 
prior distribution for the parameter or a function of 
the parameter is a uniform distribution. A uniform 
prior is an “indifference” distribution in the sense that 
it implies one wouldn’t offer odds different from 1 to I 
for any comparison of two sets of values for the para- 
meter The implication of this is that so-called classical 
procedures are but a subcase of the Bayesian model. 
Looked at m this light, Bayesian statistics loses some 
of its strangeness. Secondly, it means that classical pro- 
cedures apply When the prior information is essentially 
zero. One can be a Bayesian and do classical analysis 
when one finds himself in the “no information” state. 
i ore important, however, it forces us to consider the 
possibility that we do know something about the pro- 
cess under study and therefore, to consider the use of 
some other prior distribution. As I. J. Good said; 

Consider any statistical technique with which you 
have some sympathy Find out whether it is equivalent 
to the use of an initial probability distribution by us- 
ing Bayes’ theorem in reverse. Then replace this in- 
itial distribution by a better one.” 



. . f , * concerns tne clistnbu- 

non of the mean vector p, i„ a multivariate normal 
distribution. Geisser and Cornfield (1963) used a 
amily of indifference priors for the mean vector which 
depended on a positive integer, V. The posterior dis- 

if! v !i°o 1S then 0ne of a cIass Spending on V. 

i thC P osterior probability intervals are the 

fiducial intervals which follow from Fisher’s theory of 

fiducial inference. If V = r* + i . 

. v-p-f-x, tlien the posterior 

ntervals for p are the same as the confidence intervals 

based on Hotelling's T- distribution. One could in- 

thT^h *“ reSult “ mean - at leas ' for this situation, 
hat the difference between these two major modes of 

inference reduces to a selection of a number for V 

Furthermore, the marginal distribution of any single 

mean is t (N + 1 — V) . Only if V = 2, are the p°os 

tenor intervals the same as classical confidence inter- 
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vals. This means that one can choose a prior to give 
correspondence with the joint interval of Hotelling or 
one can choose a prior to give correspondence with 
confidence intervals on single means— but, one cannot 
do both simultaneously! For those of us who are con- 
fused about the relation of multivariate and univariate 
tests, this fact should be helpful. 

Unfortunately, the derivation of posterior distribu- 
tions from arbitrary priors is mathematically intract- 
able. One of our students, Jim Powers, is working on 
general computer programs which will allow general 
priors to be specified for the one-way anova situation 
and which will calculate the resulting posterior dis- 
tributions after observation of sample data. Once these 
programs are obtained, research on the relation be- 
tween various classes of priors and posteriors can pro- 
ceed. We will also be able to assess the effect of sample 
size on the change from prior to posterior distribu- 
tions. 

The Bayesian model is a convenient way of incor- 
porating all information about a process. To give ex- 
amples, one usually knows something about the mea- 
suring instrument used— its reliability, item charac- 
teristics, etc. We are beginning to work in this area 
to attempt to tie experimental design and measure- 
ment theory together using the Bayesian approach. 
Secondly, the problem of cross-validation is one where 
the initial sample implies a distribution of belief 
about expected results in the cross-validation sample. 

Another example of this type was given by Box and 
Draper (1965). Suppose there are m fundamental 
parameters. Observations are taken on a response 
variable which is a function of some set of the m para- 
meters. Using a different design, observations are taken 
on some other response variable which is a function 
of some set of the same m parameters. The problem is 
to use the information from both designs to make in- 
ferences about the m fundamental parameters. 



Starting with an indifference prior on the m para- 
meters, three posterior distributions are derived. The 
first two use, respectively, only the information gained 
from the separate designs, while the third is the final 
posterior distribution resulting from consideration of 
the observations from both designs. By comparing 
these posterior distributions one can see the relative 
contribution of each set of observations. One applica- 
tion of this model to education and psychology is to 
think of the m parameters as fundamental ability con- 
stants and the designs as representing different tests 
and tasks. 

Another highlight of recent research is that so-called 
classical statisticians are making use of Bayes’ theorem 
Even though their approach is conceptually different, 
a Bayesian can feel quite comfortable with their 
methods and results. One development is called the 
“empirical Bayes’ approach.” If we look at the de- 
nominator of Bayes’ theorem: 

/fi(e)f 2 (xle)de 

we see that it is the unconditional distribution of X, 
g (X) . This has also been called the predictive dis- 
tribution of X. If we successively sampled from a proc- 
ess with parameter, e varying according to ( e ) 

then we could build up an empirical distribution of 
X which will approximate g (X) . Since f 2 . (xle) is 

known, fj(e) is then known implicitly. 

An application of this was given by F. Lord (1964) 
writing in the context of measurement, theory. The un- 
known f ( e ) is a distribution of true scores while the 

empirical distribution, g (x), is an observed distribu- 
tion of test scores. 
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HIGHLIGHTS OF RECENT RESEARCH CURRICULUM AND TEACHING 



Glenn E. Reeling, Jersey City State College 

Many innovative aspects have been associated with 
teaching and curriculum during the past few years. 
The purpose of this paper will be to describe briefly 
research which is currently being conducted in two 
subject areas at the elementary level in the Montclair, 
New Jersey, Public Schools as well as some of the re- 
search which is being conducted in the East Orange 
(New Jersey) Public Schools. 

The first study concerns the Initial Teaching Alpha- 
bet (i/t/a) as a method of teaching reading to first 
grade pupils in the Montclair Public Schools. In this 
experimentally designed project, 550 first grade pupils 
in the Montclair Public Schools. In this experi- 
mentally designed project, 550 first grade pupils were 
placed into either an experimental group (teaching 
via i/t/a) or into a control group which was taught 
by the traditional orthogonal (t.o.) manner. These 
groups were matched for the factors of sex and for the 
scores which were obtained on the Lee-Clark Reading 
Readiness Test in their kindergarten year. 

During March of the first grade year, before any of 
the i/t/a pupils had the opportunity to make the 
transition to t.o., both groups of pupils were admin- 
istered the Primary I Battery of the Metropolitan 
Achievement Tests. (The i/t/a edition of the MAT 
was administered to the pupils who were being taught 
by i/t/a.) In analyzing the test results, it was discov- 
ered that the i/t/a group of first grade pupils had 
obtained significantly higher ( p < .001) scores in the 
test areas of Word Knowledge, Word Discrimination, 
and Reading. In the test area of Arithmetic, the mean 
raw scores of the i/t/a and the t.o. groups were 52.3 
and 52.5 respectively-which the writer viewed as a 
verification of the initial equality of the two groups. 

Three months later, during June, both groups of 
pupils were administered the regular t.o. edition of 
the Stanford Achieveme?it Tests. Results of this test 
administration indicated that the i/t/a group of 
pupils again obtained significantly higher (p<. 01) 
scores in the test areas of Word Readiness, Paragraph 
Meaning, and Vocabulary. 

During the last week of school, a noncognitive mea- 
sure-designed by the writer-was administered to all 
the first grade pupils. This test was administered 



orally by the writer with the first grade pupils indicat- 
ing their answers by circling either “Yes” or “No” on 
an answer sheet to questions such as: 

Do you like numbers better than reading? (No) 

Would you like to get a book for a present? (Yes) 
For eight of 25 such questions (including the two 
noted above), the responses of the pupils in the i/t/a 
group differed significantly (p<. 01) from the re- 
sponses of the pupils in the t.o. group. 

The second study which is currently being con- 
ducted at the elementary level in the Montclair Public 
Schools is also an experimentally designed study in 
which an attempt is being made to discover the effec- 
tiveness of teaching science by the inquiry method. 
Fifth and sixth grade pupils will serve as subjects for 
this study, and these pupils will generally be matched 
in terms of scholastic aptitude and achievement, and 
socioeconomic level. The pupils in the experimental 
group will be taught the science course using Such- 
man’s materials as they are found in the SRA Science 
Inquiry Development Program. Two of the major 
problems which may apparently be encountered in 
this study are: (1) having the classroom teachers teach 
by the inquiry method; and (2) obtaining an evalua- 
tion of the processes rather than the product. 

Filially, the writer should mention a research project 
presently being conducted in the East Orange Public 
Schools for which he is serving as a consultant. A pilot 
Intermediate School for fifth arid sixth grade pupils 
has been established in which many innovational fea- 
tures (funded by both ESEA Title III and Ford Foun- 
dation) are now in operation. Included among the 
more recent innovative instructional practices are 
Computer Assisted Instruction, team teaching and 
nongraded instruction, and individually prescribed 
instruction. Other innovative features include open 
spacing, flexible placement of study carrels, and a 
comprehensive instructional materials center. 

AVith studies such as those mentioned above being 
conducted at the present time, research in the teaching 
and curriculum areas appears to be an increasingly 
piominent factor in the field of education. And as the 
findings from this research are implemented, hopefully 
our school children should be the recipients of better 
instructional practices in the future. 
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THE DEMONSTRATION OF COMPUTER-AIDED INSTRUCTIONAL SYSTEMS 

AND OTHER COMPLEX EDUCATIONAL MEDIA 

Chairman , Richard L. Wing, BOCES #1, Westchester County, New York 

Participants: Robert E. Taylor, Mt. Kisco School District; 

Father John Boyle, Fordham University College of Philosophy and Letters; Walter Goodman, 

BOCES #1, Westchester County. 



Father Boyle described the operation and advan- 
tages of the closed circuit installation at Loyola Semi- 
nary which is designed primarily to train future Jesuit 
educators in the use of television as an instructional 
medium. However, Father Boyle stressed, although 
this is its primary function, the system can serve as a 
variation of a standard closed circuit origination sys- 
tem that could be incorporated into any school system. 

The installation consists of two cameras; one of 
which is horizontally mounted on a rolling stand that 
includes lights and monitors, while the other is ver- 
tically mounted and fixed into what is called the 
"Graphics Console.” 

This installation is unique in that the entire opera- 
tion can be controlled by one person, the teacher. The 
teacher controls the switching from one camera to 
another, and controls, as well, the incorporation of an 
audio tape recorder and carousel slide projector. The 
image from the 2x2 projector is transmitted under 
the Graphic Console, and via a multiplex mirror ap- 
pears on the ground glass screen directly below the 
vertically mounted camera. 

The instructor also determines the composition of 
the graphic material on the television screen since he 
can control the zoom lens of the vertically mounted 
camera. Because all of the controls are within easy 
reach of the teacher, if he chooses, he can be a teacher, 
director, technidan and cameraman, all in one. 

In its very simplicity, this relatively unsophisticated 
system affords many advantages. First of all, the 
teacher can be given, in ten minutes, the minimal 
knowledge he needs to have. A few minor hints about 
studio techniques completes his orientation. Secondly, 
the fact that lie can come to the studio on his own 
time, can prepare materials and can practice as long 
as he likes without the need of gathering a studio 
crew, opens unlimited opportunities for experimenta- 
tion in the use of graphics and three dimensional 
objects. 



Experience has shown that the flexibility of the in- 
stallation has produced a rapid increase in the imagi- 
native creativity of presentations by teachers-in-train- 
ing. 

Father Boyle concluded by saying that closed circuit 
television could also be used for research. 

Mr. Taylor described the Dial Selection System to 
be in operation at the Middle School of the Bedford 
Central School System about January 15, 1968. 

There are three essential components of any Dial 
Selection System. First, is the media center, which 
serves as the master control for the DSS. This area will 
be equipped with a program distribution and monitor- 
ing console, video switching systems, and all program- 
originating equipment. The console will distribute 
and monitor programs and will be able when neces- 
sary to enable the technician to communicate with 
persons at any of the stations equipped with dial con- 
trol plates. Second, carrels, equipped to handle one or 
two students, will consist of booths with acoustical and 
physical isolation. Each carrel will provide the student 
with an opportunity to select any of the available AV 
materials using the dial control plate or microphone 
and then the video monitor or headset. Third, teachers 
in 30 group instruction areas will be able to dial-select 
or call directly for any of the AV materials distributed 
from the Media Center. The video and audio portion 
of the program will be distributed through a monitor 
mounted on the wall. 

Mr. Taylor concluded, by stressing that in spite of 
the most advanced and sophisticated and complex 
hardware, it is not the mode of instruction, or the 
hardware itself that will spell success or failure for 
Dial Selection Systems; it is rather the software, that 
is, the programmed materials in the lessons themselves 
and how they are prepared, selected, and integrated 
into the curriculum that will be the determining 
factors. Mr. Goodman stated that since 1962 the Board 
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of Cooperative Educational Services in Bedford Hills, 
Westchester County, New York, has conducted re- 
search on the use of computer-based economic games 
as an instructional method. The latest project. Project 
No. 2841, sponsored by Cooperative Research, U.S. 
Office of Education, is entitled. The Production and 
Evaluation of Three Computer-Based Economics 
Games for the Sixth Grade. 

One of three games developed is the Sumerian 
Game , designed to teach sixth graders some basic prin- 
ciples of economics in operation at the time of the 
neolithic revolution in Mesopotamia. 

The student playing the game, takes the role of a 
rulers son in the city-state of Lagash in the year 3500 
B.C. He is presented with his first problematic situa- 
tion: “We have harvested 5,000 bushels of grain to 
take care of 500 people. How much of this grain shall 
be set aside for the next season’s planting, and how 
much will be stored in the warehouse? The remainder 
will be given to the people to eat.” 

The child makes decisions and enters his answers at 
the computer terminal. The computer immediately re- 
turns a progress report, including the harvest reaped 
from the seed grain set aside for planting, a word in- 
dex as to the standard of living, and a report on his 
inventory. This kind of problem is repeated through- 
out the entire game, each harvest representing six 
months in the life of a ruler. 

The rule of the first Luduga is devoted to the solu- 
tion of problems pertaining to an agricultural econ- 
omy. In the second phase of the game, the diild as 
Luduga II is given the opportunity to apply his sur- 
plus grain to the development of crafts. In the third 
and final stage he is introduced to trade and the more 
complex problems which confront a changing econ- 
omy. The rate and trend of development are deperid- 
- ent upon the wisdom of the child’s decisions. At inter- 
vals the ruler is presented with technological innova- 
tions and disasters which will alter his decisions. 

The essential idea behind the second game, the 
Sierra Leone Development Project, is to simulate the 
economic problems of a newly emerging nation, plac- 
ing a secondary emphasis on a study of the country’s 
culture. The simulated economic and social situations 
used in this game are drawn from actual problems dis- 
cussed in the Ten-Year Social and Economic Develop- 
ment Plan now in effect. A specific and already par- 
tially successful example is the land reclamation pro- 
gram and the use of this former marshland to cultivate 
rice in order to diversify agriculture and to decrease 



expenditures for imported food, in the effort to obtain 
a favorable balance of trade. As the student, taking a 
role as an A.I.D. officer, satisfactorily completes and 
shows an understanding of the problems presented to 
him, he is promoted to Assistant Affairs Officer and 
finally to Chief Affairs Officer in A.I.D. 

In the third game, called The Free Enterprise Game, 
the player initially assumes the role of the owner of a 
small toy store. In utilizing the opportunities provided 
by the simulated store environment and while making 
decisions to combat those factors in the environment 
which would be detrimental to the operation of a 
small business, the player should be able to increase 
the net worth and monthly sales of his store. 

It is hoped that after playing the game the player 
will realize that each possible decision in a given cir- 
cumstance tends to carry certain rewards and costs and 
that the rational decision to make is one which mini- 
mizes costs and maximizes rewards within a probabilis- 
tic framework. 

The educational planning for these games has been 
accomplished by local teachers and a graduate student 
at Johns Hopkins. 

Equipment used in these projects included IBM 
1050 typewriter terminals, an experimental random 
access slide projector, and an IBM 7090 computer us- 
ing a time sharing system, so that several pupils could 
be taught at the same time. 

Dr. Wing said that in order to assess the results of 
the games described previously by Mr. Goodman, an 
experiment was set up along these lines. From October 
1965 to March 1966, 25 sixth grade students from the 
Mohansic School in Yorktown Heights, New York, 
played the two games on three terminals at the Center 
for Educational Services and Research of BOCES. 
These pupils started in some cases with the Sumerian 
Game and in other cases with the Sierra Leone Game, 
then completing the other. Meanwhile a control class 
of equal ability studied about the economics of life 
in Sumer and Sierra Leone under the direction of a 
talented teacher using ingenious but “conventional’’ 
methods. 

The basic evaluation problem has been to appraise 
a combination of two methodological procedures em- 
ployed in conjunction with each other, one the game 
method of instruction and the other the use of com- 
puter-based typewriter terminals for delivery of the 
games. The purpose was to find out whether, by using 
these two methodological approaches, we could pro- 
vide an individualized learning situation in which the 
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students were able to proceed at their own rates, were 
able to learn something about economics, and would 
find the experience stimulating. 

The effectiveness of the whole experiment was mea- 
sured by several different techniques. One was to ob- 
serve the students carefully and interview them after 
they finished playing the games. Another was to com- 
pare their pretest and posttest scores on specially pre- 
pared tests of economic understandings, and a third 
was a depth interview technique designed to probe for 
understanding of economic concepts. 

The equivalence cf the control and experimental 
groups v/as established by making a t-test of the dif- 
ference of mean scores on the California Test of Men- 
tal Maturity and the Reading Section of the Iowa Test 
of Basic Skills, as well as by comparison of scores on 
the pretest of economic principles. It was found that 
there was no significant difference between the two 
groups on these variables. 1 

After a few initial program errors were cleared up, 
the games ran smoothly. Instruction was self-sufficient 
to the extent that most of the students required no 
assistance with the instructional aspects of the games. 

In regard to the interest which students had in the 
games, we found that almost without exception the 
pupils enjoyed playing these economic games on the 
computer, and this high interest was maintained 
throughout the two games, which lasted an average of 
15 hours in total. 

It was found that in the Sumerian Game the experi- 
mental group gained a significantly greater amount 
from pretest to posttest than the control group. This 
difference in gain was significant at the 1 percent level 
of confidence. In the Sierra Leone Game the control 
group scored slightly but not significandy better than 
the experimental group; - 

It appears from our testing that we should not claim 
that the computer-game technique is clearly superior 



to classroom instruction. It does seem, however, that 
the experimental method is at least as effective, to 
judge by the measurement which we employed. 

In the experimental setting the average pupil time 
on the Sumerian Game was 10 hours and 15 minutes 
with a range from 6 hours and 40 minutes to 14 hours 
and 5 minutes. The average time on the Sierra Leone 
Game was 5 hours and 5 minutes with a range from 
3 hours and 55 minutes to 8 hours and 0 minutes. The 
combined average then is about fifteen and a half 
hours to complete both games. 

It seems, therefore, that studying by games on the 
computer took less time than studying the same ma- 
terial in class. 

Relationships Between Learning and Factors 
of Individual Difference 



Tabic of Correlations 



Gain, Pretest— Posttest 


versus Sumerian Game 


Sierra Leone 
Game 


a. Time on Computer 


-.199 


-374 


b. Reading Ability 


+.228 


+.417 


c. Intelligence 


+.388 


+.546 



a) Apparently the students who spent the least time 
at the computer made the greatest gains. 

b) There was a low positive correlation between 
reading ability and improvement of test score. 

c) The more intelligent students gained more from 
pretest to posttest than the less intelligent students, 
even though there is a ceiling on the test which pre- 
vents the best students from displaying the whole 
range of their talents. 

General conclusion: Analysis of the computer-based 
economics games project demonstrated that there is 
sufficient promise in this kind of instruction to warrant 
further, exploratory research both with the computer 
medium and the game mode. 



i Francis G. Cornell is project statistician. 
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NEEDED RESEARCH IN TEACHER EDUCATION: 
THEORY BASED PROGRAMS AND TEACHER EDUCATION 

Lawrence V. Castiglione, City University of New York, Queens College 



Systematic, comprehensive theories of teaching, in 
the formal sense of the term, do not now exist. What 
should be the nature and function of teacher educa- 
tion programs is unclear (Anderson, 1962) . Glazer 
(1966) feels that statements of educational goals are 
platitudes, subject to so many interpretations that 
evaluation in terms of specific student behaviors is 
impossible. Only recently have researchers begun to 
focus their attention on the teaching process. It is 
hardly surprising, given this state of affairs, that there 
are not programs of teacher education that have im- 
plicit in them a theory or theories of teaching. The 
two necessary, if not sufficient conditions — a clear state- 
ment of fundamental policy and an empirically 
grounded, comprehensive theory of teaching— have not 
been met. 

Scandura (1966) along with others, maintains that 
at present teaching is a practical endeavor, and its 
practice more an art than a science. He holds that 
there are certain utilities that are characteristic of 
science and technology that are not shared by an art, 
and that education would benefit by the transition 
from art to scientific technology. Skinner claimed that 
education is in principle a scientific technology that 
could be made operational if cultural inertia were 
overcome. Skinner expressed this opinion in 1954. To 
date there is no substantial evidence that teacher edu- 
cation has become or is about to become a scientific 
technology. 

The delay in implementing what is already known 
may be in part due to the fact that the concerns of 
classroom teachers overlap only slightly the concerns 
of psychologists in laboratories. This is most apparent 
in the psychological study of learning. Bruner (1964) 
writes that learning theories focus upon a description 
of the processes of learning, and that teaching theories, 
as distinguished from learning theories, should be 
concerned with specifying the means by which learn- 
ing may be facilitated. Ausabel (1966) takes the posi- 
tion that this distinction holds in a formal sense only, 
in that theories of learning, by specifying optimal 



conditions and the variables affecting learning, imply 
appropriate teadier behavior. 

However, there is little evidence to support the no- 
tion that complex molecular systems, however clearly 
described to a student, will result in appropriate be- 
havior in the absence of detailed instruction directed 
to that end. Travers (1965, p. 529) states that, “Teach- 
ers do not change their ways of behaving simply by 
being told that learning would proceed with greater 
efficiency if they behaved differently.” James Thurber 
(Mandler & Kesson, 1964) once wrote that “A word 
to the wise is not sufficient if it doesn’t make any 
sense.” 

Perhaps the difficulty in communication between re- 
searchers and teachers might be reduced by employ- 
ing instructional practices suggested by learning 
theories to the training of teachers, rather than im- 
plying, as Schutz and Silberman (1966, p. 298) put 
it, “. . . that the process of extrapolating the theory 
into practice is simple and straightforward.” For ex- 
ample, developing and using techniques for simulating 
specific aspects of classroom teaching operations in 
order to develop proficiency, applying instructional 
devices and materials, and using diagnostic evaluations 
might be as effective as lecturing. 

Presumably teaching theories would permit one to 
prescribe behaviors that would facilitate learning in a 
predictable manner under known conditions. Teachers 
should be able to decide between various alternatives 
on a systematic basis within the context of a standard 
classroom setting. 

Taxonomies of teacher behavior derived from al- 
ready existing observational systems .might conceiv- 
ably form the basis, or elements, of a theory of teach- 
ing- The classes of these observational systems range 
from power relationships (Hughes, 1963) to classifica- 
tions borrowed from information theory (Ryans, 
1963) . Scandura (1966) points out that beyond Gage’s 
suggestion that teaching be treated as an independent 
variable and learning as a dependent variable, teach- 
ing theories must take into account individual dif- 
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ferences in achievement and ability as well as the tim- 
ing and sequencing of information. 

Groen and Atkinson (1966) have proposed a model 
for the dynamic programming of a class of instruc- 
tional problems that treats instruction as a multistage 
decision process which is subject to evaluation by 
means of a mathematical theory. Optimal stimulus 
presentation strategies, sensitive or insensitive to stu- 
dents’ responses, may be approximated. Although not 
directly applicable to classroom teaching, this model 
may provide a useful conceptual approach in formulat- 
ing a theory of teaching. Certainly, the idea of stimu- 
lus presentation decisions as an instructional strategy 
directed toward clearly defined objectives of instruc- 
tion, may serve as one possible locus of transition from 
the art of teaching to the science of instruction. 

It is obviously necessary to have a well developed 
theory of teaching to enable one to clearly specify 
important elements of behavior, to formulate alterna- 
tive hypotheses, and to meaningfully interpret differ- 
ences between experimental treatments. Research 
should attempt to identify the major sources of vari- 
ance in student learning attributable to teacher be- 
haviors, and the influence on school learning of these 
behaviors under classroom conditions. The current 
lack of comprehensive theory notwithstanding, even a 
pre-theoretical model with limited application would 
establish a basis for evaluating the effectiveness of in- 
struction interpre table within the context of the model 
employed. An attempt in this direction, almost by 
definition, would move educational practice and pro- 
grams closer to becoming a scientific technology than 
has thus far been the case. 
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NEEDED RESEARCH IN TEACHER EDUCATION: 
SENSITIVITY TRAINING AND THE PROCESS OF CHANGE 

Julian Roberts, Yeshiva University 



One important aspect of teacher education that 
needs further study is the preparation of preservice 
teachers for adequate handling of the phenomenon 
of change. The several aspects of teacher education 
that emphasize change in the curriculum, change in 
role perception of the teacher and of the learner, 
change in the notions of how instruction is truly in- 
dividualized, somehow have not really explored how 
newcomers to the profession may enter a world where 
these aforementioned changes may serve to threaten 
individuals, or even whole school systems. 

In the time allotted, I would like to share with 
you one illustration of the processes involved in intro- 
ducing change into a school setting, simply to high- 
light the complexity of the problem. In a suburban 
community on Long Island, a pilot project was in- 
itiated last year to explore the possibility of changing 
the noted lack of effective communications among the 
several levels of the community. Four adult commu- 
nity members, representing diverse roles (parent, ex- 
school board president, the leaders of the 2 forces pro 
and con in a proposed bond issue) , the school superin- 
tendent, 3 teachers, and 7 eleventh grade students en- 
gaged in a t-group experience. T-group is a process 
developed by the National Training Laboratories, a 
subsidiary of the NEA. It is defined by Benne and 
others as follows: 

A T-group is a relatively unstructured group in 
which individuals participate as learners. The 
data for learning are not outside these individuals 
or remote from their immediate experience 
within the T-group. The data are the transactions 
among members, their own behavior in the group, 
as they struggle to create a productive and viable 
organization, a miniature society; and as they 
work to stimulate and support one another’s 
learning within that society. Involving experiences 
are a necessary, but not the only, condition of 
learning. T-group members must establish a 
process of inquiry in which data about their own 
behaviors are collected and analyzed simulta- 
neously with the experience which generates the 
behavior. Learnings thus achieved are tested and 
generalized for continuing use. Each individual 
may learn about his own motives, feelings and 
strategies in dealing with other ^persons. He 



learns also of the reactions he produces in others 
as he interacts with them. From the confronta- 
tion of intentions and effects, he locates barriers 
tp full and autonomous functioning in his rela- 
tions with others. Out of these he develops new 
images of potentiality in himself and seeKs help 
from others in converting potentialities into ac- 
tualities. 

Each individual may learn also about groups in 
the processes of helping to build one. He may 
develop skills of membership and skills for 
changing and improving his social environment 
as well as himself. The staff who work with T- 
groups do not see any necessary opposition be- 
tween participation in groups and autonomous 
individual functioning, though they are well 
aware that opposition does occur in many asso- 
ciations of our lives and that group forces may 
be used to inhibit personal development. In the 
T-group, on the contrary, the objective is to mo- 
bilize group forces to support the growth of mem- 
bers as unique individuals simultaneously with 
their growth as collaborators. Influences among 
peers are paramount in this learning process. In 
the T-groun, members develop their own skills in 
giving and receiving help. They learn to help 
the trainer or teacher as he assists in the develop- 
ment of individual and group learnings. 1 

The National Training Lab lists the following five 
factors as most important objectives of human rela- 
tions sensitivity training: 

Self-insight 

Better understanding of other persons and aware- 
ness of one’s impact on them. 

Better understanding of group processes and in- 
creased skill in achieving group effectiveness. 
Increased recognition of the characteristics of larger 
social systems. 

Greater awareness of the dynamics of change. 

A training laboratory tries to create a climate en- 
couraging learnings, understandings, insights, skills in 
the areas of self, group, and organization. The pre- 
liminary examination of the responses of the partici- 
pants to two questionnaires indicates that a notable 



„ Le J a 2£ Bradford, Jack R. Gibb, and Kenneth D. Benne, T- 
Group Theory and Laboratory Method. New York: Tohn Wilev 
& Sons, Inc., 1964. J 7 
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degree of achievement of these objectives has been 
reached. 

An analysis of the process of T-group reveals its 
relationship to the total complex of the process of 
change. The rationale indicates that before change can 
take place effectively, people affected by such change 
must learn how to interact with each other so that 
greater productivity may result as the change takes 
effect. From this experience, a present research project 
was evolved and is now in operation. How can a class- 
room setting be changed so that interaction between 
the student and teacher, and student and student may 
give everyone an opportunity to provide maximum 
performance of all involved in the educational process? 

Such a change necessitates new role concepts for 
both teacher and student. The teacher must move 
from a highly directive person and leader to one who 
becomes a more highly integrative leader, one who 
readily accepts statements of choice, differences of 
opinion, and suggestions for new ways of proceeding 
within the classroom setting. The student too must 
move from one who seeks to develop thinking patterns 
convergent with those of the teacher or those he feels 
are the pacesetters of his peer group to one who is not 
afraid to express divergent thinking. His role becomes 
more creative, less limited in response pattern, more 
original. He, too, must exhibit behavior that recognizes 
differences, and willingness to accept responsibility 
for suggesting new ways of proceeding. 

Changes such as those suggested above may threaten 
both teachers and students. T-group training in self- 
awareness, in ability to listen to others, to see how 
others perceive you and how you rightly or wrongly 
have perceived others is one possible way to handle 
the threats posed by change. The classroom setting 
used in this experiment is 12th grade social studies: 
Problems of Democracy. Hilda Taba points out that 
social studies are always involved with feelings and 



attitudes. Thus a class in Problems of Democracy must 
be concerned with notions of self, of uniqueness, of 
group membership, and group process. The climate to 
be developed in such a class must include: a) the ca- 
pacity to identify with people from different back- 
grounds within the community, avoiding or overcom- 
ing stereotypes that hinder real understanding of, and 
respect for others; b) the self-security that permits one 
to be comfortable in differing from others; c) the 
openmindedness that examines the opinions and ways 
of others with reasonable consideration and objec- 
tivity; d) the acceptance of changes that adjusts as a 
matter of course to new ways and events; e) the tol- 
erance of uncertainty and ambiguity without anxiety; 
and f) the responsivness to democratic and human 
values. 2 

T-group should allow for a greater degree of 
achievement of these objectives. The very essence of 
sensitivity training calls for the development of per- 
sonal attributes and abilities to cope with elements in 
the environment that are inhibiting the teaching- 
learning process. 

What this short paper is suggesting, then, is that 
further research in the nature and process of change 
is mandatory if climates that will promote change in 
the most positive and profitable sense are to be estab- 
lished in the school setting. The work of Beliak on 
the language of die classroom has already indicated 
the degree to which the oral behavior of teacher to 
student or student to student may inhibit an individ- 
ual’s attempt to recognize, use and develop his poten- 
tial, and his ability to learn. Other techniques must be 
investigated. If we mean to produce teachers who will 
be prepared to do more than perpetuate an educa- 
tional system that has revealed its shortcomings, then 
Federal, State, and local support must be given to en- 
courage further research in this area. 



2 Hilda Taba and James L. Hills. Teacher Handbook for Con- 
tra Costa Social Studies Grades 1-6, San Francisco, California 
1965. 



